-- Logs begin at Tue 2022-06-07 12:25:30 UTC, end at Tue 2022-06-07 13:34:47 UTC. -- Jun 07 13:02:50.581187 dv-cinder-844962-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:02:50.590292 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:02:50 2022] *** Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: nodename: dv-cinder-844962-1-iscsi Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: machine: x86_64 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: clock source: unix Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: pcre jit disabled Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: detected number of CPU cores: 4 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: current working directory: / Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: your processes number limit is 47680 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: your memory page size is 4096 bytes Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: detected max file descriptor number: 2048 Jun 07 13:02:50.592312 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: lock engine: pthread robust mutexes Jun 07 13:02:50.593844 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: thunder lock: enabled Jun 07 13:02:50.593844 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:02:50.593844 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:02:50.637692 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: Python main interpreter initialized at 0x564dcdd2b9c0 Jun 07 13:02:50.637692 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: python threads support enabled Jun 07 13:02:50.637692 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: your server socket listen backlog is limited to 100 connections Jun 07 13:02:50.637692 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:02:50.638089 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:02:50.638089 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: *** Operational MODE: preforking *** Jun 07 13:02:50.638406 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:02:50.638406 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: spawned uWSGI master process (pid: 103428) Jun 07 13:02:50.638633 dv-cinder-844962-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:02:50.640275 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: spawned uWSGI worker 1 (pid: 103429, cores: 1) Jun 07 13:02:50.640275 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: spawned uWSGI worker 2 (pid: 103430, cores: 1) Jun 07 13:02:50.640830 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:02:51.875943 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:02:51.923616 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:02:52.583288 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:02:52.583288 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: from cryptography.utils import int_from_bytes Jun 07 13:02:52.583572 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:02:52.583572 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: from cryptography.utils import int_from_bytes Jun 07 13:02:52.598087 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:02:52.598087 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: from cryptography.utils import int_from_bytes Jun 07 13:02:52.598424 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:02:52.598424 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: from cryptography.utils import int_from_bytes Jun 07 13:02:55.135884 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:02:55.136557 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:02:55.136640 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:02:55.136640 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:02:55.137165 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:02:55.137257 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:02:55.137336 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:02:55.137336 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:02:55.137454 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:02:55.137526 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:02:55.137696 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.137916 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138048 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138200 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138301 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138518 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138605 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.138864 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139009 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139158 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139495 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139638 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139784 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.139881 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140126 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140258 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140354 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140433 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140674 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140806 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.140991 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-1-iscsi {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141180 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141282 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141364 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-1-iscsi {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141621 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141752 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.141930 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142063 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142239 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142386 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142512 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142620 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142841 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.142971 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.143139 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.143270 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.143452 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.143600 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.144849 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145042 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145042 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145285 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145425 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145549 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145675 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.145796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146283 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146414 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146550 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146670 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146788 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.146914 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147034 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147159 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147279 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147399 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147643 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147643 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147870 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-1-iscsi {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.147870 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148091 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-1-iscsi {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148218 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148337 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148455 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148579 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.148885 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149100 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149391 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149514 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149637 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149792 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.149919 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150127 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150310 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150452 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150581 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150711 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.150841 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151034 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151211 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151363 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151491 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151629 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151838 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.151974 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152095 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152225 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152347 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152467 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152587 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152797 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.152975 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153157 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153286 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153417 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153539 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153659 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153778 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.153908 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154031 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154182 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154309 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154527 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154719 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154853 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.154983 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155105 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155311 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155488 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155641 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155768 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.155890 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156010 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156152 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156327 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156451 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156574 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156692 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156818 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.156975 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157157 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157281 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157408 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157612 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157792 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.157928 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158062 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158184 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158303 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158463 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158592 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158759 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.158895 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159102 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159292 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159523 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159657 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159798 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.159928 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160207 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160340 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160460 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160590 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160753 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.160885 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161118 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161247 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161424 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161581 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161728 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.161829 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162043 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162355 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162468 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162659 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162756 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.162963 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163060 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163266 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163361 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163568 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163655 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163876 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.163961 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164336 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164420 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164497 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164697 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164790 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.164993 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165097 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165330 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165425 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165626 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165717 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.165924 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166019 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166224 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166317 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166519 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166606 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166817 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.166905 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167111 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167196 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167415 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167501 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167716 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.167803 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168023 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168180 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168328 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168452 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168631 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168762 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.168933 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169084 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169260 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169391 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169562 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169685 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169864 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.169987 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170165 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170299 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170465 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170587 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170763 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.170895 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171063 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171194 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171364 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171486 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171663 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.171786 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172048 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172180 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172311 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172432 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172551 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172670 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172847 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.172983 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173181 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173307 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173482 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173613 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173779 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.173909 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174087 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174215 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174379 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174509 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174678 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.174813 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175002 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175163 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175310 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175570 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175701 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.175876 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176015 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176174 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176298 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176472 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176605 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176769 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.176892 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177089 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177215 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177388 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177524 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177685 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177808 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.177976 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178097 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178272 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178402 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178586 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178711 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.178888 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179008 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179189 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179320 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179488 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179613 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179786 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.179908 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.180104 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:02:55.180230 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.180429 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.180558 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.180756 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.180885 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181085 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181220 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181416 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181547 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181743 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.181874 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182054 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182250 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182374 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182502 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182654 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182788 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.182966 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183088 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183295 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183437 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183605 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183738 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.183914 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184050 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184225 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184347 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184540 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184670 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.184856 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185085 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185220 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185340 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185493 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185625 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185804 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.185928 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186107 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186239 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186416 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186547 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186729 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.186850 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187041 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187162 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187349 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187481 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187663 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.187784 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188002 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188133 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188306 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188437 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188623 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188745 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.188936 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189087 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189262 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189387 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189555 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189679 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189859 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.189990 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190166 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190307 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190654 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190864 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.190996 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191176 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191303 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191491 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191615 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191801 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.191924 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192112 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192260 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192452 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192577 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192717 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.192850 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193047 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193174 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193380 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193514 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193692 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193824 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.193999 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194129 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194305 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194437 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194610 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194741 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.194915 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195045 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195221 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195352 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195523 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195656 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195824 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.195946 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196118 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196240 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196421 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196546 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196719 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.196842 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197073 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197199 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197360 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197488 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197660 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197790 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.197976 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198107 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198274 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198398 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198589 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198715 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.198961 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199093 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199223 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199344 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199496 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199621 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199800 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.199937 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200109 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200241 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200417 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200541 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200723 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.200852 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201063 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201191 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201368 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201490 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201669 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201804 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.201969 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202090 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202268 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202386 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202585 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202718 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202864 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.202998 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203163 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203284 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203467 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203601 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.203889 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204070 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204192 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204376 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204497 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204679 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.204803 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205073 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205214 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205344 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205466 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205625 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205747 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.205940 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206062 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206281 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206411 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206603 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206734 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.206919 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207053 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207223 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207357 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207530 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207655 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207834 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.207972 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208134 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208256 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208435 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208558 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208731 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.208861 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209045 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209171 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209349 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209483 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209647 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209783 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.209944 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210070 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210243 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210366 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210548 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210671 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210844 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.210962 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211141 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211272 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211433 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211569 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211730 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.211860 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212050 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212173 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212359 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212482 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212699 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.212830 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213006 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213133 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213337 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213468 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213639 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213764 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.213948 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214080 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214253 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214376 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214558 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214683 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214863 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.214993 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215164 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215288 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215470 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215592 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215771 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.215901 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216082 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216206 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216384 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216507 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216695 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216825 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.216997 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217132 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217333 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217458 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217634 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217772 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.217938 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218061 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218252 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218377 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218580 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218702 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.218889 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219012 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219204 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219327 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219508 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219633 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219816 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.219938 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220118 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220241 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220422 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220546 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220719 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.220841 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221049 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221175 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221355 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221484 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221654 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.221777 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222011 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222137 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222462 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222586 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222776 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.222896 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223092 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223208 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223398 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223495 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223693 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223787 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.223999 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224101 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224307 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224392 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224633 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224719 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.224933 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225114 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225263 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225350 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225578 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225663 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225884 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.225980 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226189 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226277 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226492 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226578 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226794 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.226882 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227093 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227178 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227394 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227479 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227700 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.227786 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228005 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228091 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228307 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228392 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228605 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228692 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.228910 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229001 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229234 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229318 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229534 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229622 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229833 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.229920 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230133 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230226 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230443 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230550 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230765 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.230850 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231076 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231187 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231398 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231493 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231716 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.231803 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232022 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232119 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232326 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232419 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232643 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232728 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.232933 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233056 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233254 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233340 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233555 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233852 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.233939 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234178 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234263 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234476 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234562 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234777 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.234863 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235087 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235171 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235389 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235474 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235692 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235778 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.235991 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236081 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236293 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236379 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236596 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236681 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236900 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.236984 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237225 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237325 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237572 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237664 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237884 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.237969 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238185 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238278 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238487 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238572 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238793 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.238878 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239090 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239184 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239393 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239480 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239695 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239781 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.239989 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240082 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240288 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240380 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240593 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240680 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.240908 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.241185 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.241500 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.241594 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.241811 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.241894 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242123 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242220 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242435 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242521 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242747 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.242880 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243063 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243150 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243381 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243465 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243705 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.243789 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244004 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244101 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244309 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244409 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244610 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244704 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.244909 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245002 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245235 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245323 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245547 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245631 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245853 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.245947 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246164 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246250 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246467 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246551 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246778 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.246871 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247078 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247163 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247377 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247479 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247674 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247768 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.247977 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248070 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248273 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248357 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248575 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248669 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248873 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.248960 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249205 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249292 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249505 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249601 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249803 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.249897 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250101 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250187 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250397 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250490 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250696 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.250781 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251014 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251111 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251322 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251455 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251656 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251740 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.251979 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252064 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252276 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252361 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252574 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252660 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252896 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.252981 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253377 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253545 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253676 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253826 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.253918 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254128 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254216 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254429 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254514 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254726 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.254820 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255027 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255113 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255325 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255417 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255630 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255731 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.255933 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256020 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256229 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256315 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256531 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256630 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256826 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.256912 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257160 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257250 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257463 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257562 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257759 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.257846 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258053 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258140 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258356 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258443 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258653 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258739 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.258948 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259052 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259244 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259338 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259534 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259618 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259832 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.259916 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260126 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260211 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260424 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260509 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260718 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.260804 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261060 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261150 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261344 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261451 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261753 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.261954 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262047 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262277 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262363 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262586 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262681 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262890 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.262976 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263191 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263276 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263490 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263584 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263787 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.263920 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264085 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264389 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264484 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264694 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264780 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.264990 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265150 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265318 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265410 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265599 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265693 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265897 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.265990 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266197 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266282 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266495 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266579 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266790 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.266876 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267086 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267173 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267383 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267473 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267678 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267764 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.267973 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.268060 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.268271 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.268356 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.268575 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.268774 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269055 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269151 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269343 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269452 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269642 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269737 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.269976 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.270064 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.270274 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.270358 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.270629 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.270724 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.271283 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.271375 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.271590 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.271676 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.271906 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272003 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272213 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272299 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272519 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272605 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272832 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.272926 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273158 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273248 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273468 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273610 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273772 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.273874 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274078 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274164 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274374 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274458 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274670 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274756 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.274971 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275063 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275278 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275362 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275581 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275667 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275893 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.275979 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276205 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276297 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276523 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276607 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276817 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.276901 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277160 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277265 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277467 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277561 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.277864 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278072 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278166 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278373 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278457 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278677 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278768 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.278979 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279073 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279290 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279375 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279593 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279677 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279896 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.279994 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280198 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280285 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280501 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280586 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.280890 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281127 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281228 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281432 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281758 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.281888 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282067 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282161 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282370 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282466 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282678 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282766 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.282980 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283066 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283278 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283364 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283579 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283703 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.283999 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284085 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284332 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284432 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284630 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284793 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.284945 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285117 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285252 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285353 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285564 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285873 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.285960 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286177 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286272 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286510 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286603 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286878 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.286962 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287182 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287282 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287486 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287581 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287785 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.287873 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288085 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288171 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288384 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288475 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288696 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288789 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.288993 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289104 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289309 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289449 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289609 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289703 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.289921 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290007 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290220 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290304 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290530 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290614 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290857 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.290951 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291329 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291543 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291637 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291847 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.291932 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292241 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292325 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292544 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292647 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292852 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.292938 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.293201 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.293410 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.293525 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.293739 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.293848 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294040 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294186 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294348 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294436 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294653 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294739 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.294976 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295065 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295295 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295382 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295601 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295688 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.295910 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296005 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296208 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296294 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296528 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296624 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296844 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.296931 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297176 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297265 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297495 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297591 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297902 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.297987 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298217 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298302 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298521 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298616 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298838 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.298923 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299158 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299244 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299458 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299552 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299757 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.299850 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300109 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300200 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300415 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300524 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300710 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.300808 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301074 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301176 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301346 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301439 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301746 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.301953 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302038 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302256 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302343 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302551 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302637 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302848 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.302941 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303162 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303248 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303460 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303545 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303774 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.303914 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304080 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304168 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304397 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304497 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304713 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.304852 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305030 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305157 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305355 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305442 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305660 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305756 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.305960 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306045 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306258 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306343 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306556 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306656 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306890 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.306977 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307188 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307273 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307500 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307594 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307823 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.307909 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308145 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308231 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308450 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308544 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308777 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.308862 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309121 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309210 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309433 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309528 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309746 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.309831 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310062 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310156 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310359 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310445 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310656 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310744 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.310959 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311054 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311253 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311338 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311549 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311634 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.311845 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312014 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312150 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312241 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312432 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312526 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312729 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.312827 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313034 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313123 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313355 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313441 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313651 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313742 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.313968 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314057 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314269 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314388 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314565 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314653 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314862 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.314956 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315157 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315242 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315485 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315625 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315817 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.315955 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316150 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316307 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316472 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316566 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316760 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.316848 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317106 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317197 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317415 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317503 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317737 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.317825 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318048 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318143 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318358 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318449 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318667 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318751 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.318976 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319140 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319286 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319371 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319594 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319687 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.319905 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320003 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320204 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320290 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320513 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320598 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320820 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.320913 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.321167 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.321256 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.321686 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.321775 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322013 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322100 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322318 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322402 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322625 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322711 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.322928 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323014 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323234 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323320 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323539 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323665 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323844 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.323940 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324147 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324234 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324450 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324544 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324754 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.324841 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325094 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325181 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325412 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325511 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325730 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.325816 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326058 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326144 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326368 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326467 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326677 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326764 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.326985 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327069 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327291 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327378 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327640 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327729 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.327949 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328044 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328251 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328344 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328558 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328644 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328868 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.328965 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329200 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329287 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329507 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329595 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329813 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.329908 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330118 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330202 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330425 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330519 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330728 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.330822 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331034 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331119 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331452 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331560 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331853 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.331992 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332257 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332497 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332584 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332816 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.332903 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333145 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333234 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333456 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333543 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333766 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.333861 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.334275 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.334360 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.334585 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.334681 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.334911 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335006 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335230 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335316 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335549 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335643 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335862 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.335949 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336171 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336256 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336491 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336585 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336790 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.336876 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337116 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337205 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337422 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337517 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337726 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.337813 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338029 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338121 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338341 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338434 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338645 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338732 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.338942 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.339027 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.339254 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.339357 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.339555 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.339643 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340077 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340164 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340422 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340508 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340733 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.340818 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341079 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341180 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341399 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341484 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.341806 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342013 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342106 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342332 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342458 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342637 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342726 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.342939 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343034 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343247 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343340 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343550 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343636 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343847 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.343999 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344146 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344233 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344447 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344526 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344748 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.344836 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345068 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345156 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345374 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345459 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345671 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345758 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.345990 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346078 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346292 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346378 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346594 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346689 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.346916 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347028 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347227 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347384 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347550 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347640 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347805 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.347892 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348101 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348279 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348401 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348489 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348708 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.348795 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349006 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349135 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349332 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349418 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349630 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349716 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.349933 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350029 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350231 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350319 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350533 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350622 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350878 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.350978 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351201 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351290 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351501 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351597 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351798 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.351898 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352111 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352199 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352411 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352506 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352730 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.352824 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353086 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353177 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353364 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353451 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353711 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.353801 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.354071 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.354208 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.354650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.354779 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.354987 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355239 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355327 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355563 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355899 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.355987 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356223 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356317 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356529 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356660 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356832 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.356975 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357156 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357327 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357477 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357639 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357784 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.357949 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358089 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358257 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358393 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358564 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358699 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.358872 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359000 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359180 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359302 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359487 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359607 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359793 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.359909 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360102 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360211 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360409 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360503 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360716 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.360812 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361064 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361154 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361362 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361458 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361673 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.361766 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.362013 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.362110 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.363707 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.363824 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.363824 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.363973 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364132 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364391 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364491 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364612 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364698 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364778 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364871 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.364963 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.365119 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.365214 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.365305 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.365396 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.365962 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366067 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366151 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366233 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366312 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366394 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366481 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366577 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366659 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366745 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366827 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366906 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.366995 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367084 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367165 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367324 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367411 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367629 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367746 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.367960 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.368055 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.368262 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.368366 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.368582 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.368669 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370370 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370456 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370551 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370649 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370739 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370820 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370899 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.370978 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371057 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371146 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371229 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371308 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371387 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371387 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371539 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371621 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371700 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371778 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371865 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.371951 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372040 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372164 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372339 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372459 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372644 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.372952 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.373089 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.373306 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.373393 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.373613 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.373715 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.375651 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.375748 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.375820 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.375901 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.375976 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376057 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376134 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376208 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376289 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376357 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376423 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376497 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376497 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376645 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376712 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376786 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376853 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376928 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.376995 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377128 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377200 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377280 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377451 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377536 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377604 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377669 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377734 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377799 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.377959 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.378086 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.378367 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.378472 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.378787 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379010 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379178 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379266 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379346 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379426 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379646 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379740 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.379948 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380043 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380263 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380351 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380577 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380680 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380890 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.380978 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381218 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381305 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381546 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381647 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381850 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.381937 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382153 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382241 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382456 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382556 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382765 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.382852 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383070 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383156 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383373 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383469 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383682 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383783 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.383992 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385069 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385069 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385245 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385313 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385379 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385458 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385537 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385630 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385799 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.385880 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386007 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386106 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386198 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386281 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386398 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.386700 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387274 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387361 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387441 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387521 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387603 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387682 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387771 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387884 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.387962 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388191 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388278 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388510 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388608 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388829 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.388916 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389160 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389262 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389484 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389582 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389801 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.389888 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391352 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391453 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391546 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391631 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391711 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391790 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391869 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391957 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.391957 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392114 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392202 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392202 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392347 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392435 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:02:55.392537 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392625 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.392934 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:02:55.393206 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:02:55.449871 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO dbcounter [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Registered counter for database nova_api Jun 07 13:02:55.450816 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO dbcounter [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Registered counter for database nova_api Jun 07 13:02:55.471836 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.473776 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_db.sqlalchemy.engines [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.478693 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writer thread running {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.480438 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writer thread running {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.535883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.context [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af0611bb-ba94-47a7-9ba7-fca8b65e4503(cell1) {{(pid=103429) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:02:55.537953 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.context [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af0611bb-ba94-47a7-9ba7-fca8b65e4503(cell1) {{(pid=103430) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:02:55.540028 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_concurrency.lockutils [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:02:55.541653 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_concurrency.lockutils [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:02:55.542086 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:02:55.542432 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_concurrency.lockutils [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:02:55.543645 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:02:55.544419 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_concurrency.lockutils [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:02:55.544552 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:02:55.546404 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:02:55.546554 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO dbcounter [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Registered counter for database nova_cell0 Jun 07 13:02:55.548462 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO dbcounter [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Registered counter for database nova_cell0 Jun 07 13:02:55.550565 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO dbcounter [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Registered counter for database nova_cell1 Jun 07 13:02:55.552719 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO dbcounter [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Registered counter for database nova_cell1 Jun 07 13:02:55.558988 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.561423 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.562990 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_db.sqlalchemy.engines [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.566333 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_db.sqlalchemy.engines [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.570553 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writer thread running {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.570672 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writer thread running {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.576401 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writer thread running {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.709772 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writer thread running {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.718255 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO dbcounter [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Registered counter for database nova_cell0 Jun 07 13:02:55.719729 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO dbcounter [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Registered counter for database nova_cell0 Jun 07 13:02:55.729978 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_db.sqlalchemy.engines [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.732037 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:02:55.735109 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writer thread running {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:55.737396 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writer thread running {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:02:56.198429 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: WARNING keystonemiddleware.auth_token [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:02:56.199104 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: WARNING keystonemiddleware.auth_token [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:02:56.205753 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: WARNING keystonemiddleware.auth_token [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:02:56.206017 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: WARNING keystonemiddleware.auth_token [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:02:56.424815 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: WARNING keystonemiddleware.auth_token [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:02:56.430248 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: WARNING keystonemiddleware.auth_token [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:02:56.431208 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: WARNING keystonemiddleware.auth_token [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:02:56.436370 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: WARNING keystonemiddleware.auth_token [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:02:56.437616 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564dcdd2b9c0 pid: 103429 (default app) Jun 07 13:02:56.439827 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:02:56.441303 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-3a8f5309-c31c-466c-b4d6-39ca6bd64197 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002950 Jun 07 13:02:56.441464 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564dcdd2b9c0 pid: 103430 (default app) Jun 07 13:02:56.441716 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Jun 7 13:02:56 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:15.781507 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:15.782920 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003511 Jun 07 13:04:15.783725 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:15.799393 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_api:SELECT=3 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:15.800490 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_cell1:SELECT=3 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:15.801538 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_cell0:SELECT=3 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:15.802672 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:16.221062 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-441b92c2-7b9f-4cf5-84db-ee34817a1939 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:16.250956 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-441b92c2-7b9f-4cf5-84db-ee34817a1939 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461160 Jun 07 13:04:16.251743 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jun 7 13:04:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:18.573345 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:18.574957 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-6df5719c-4a80-4cdb-a375-d96dd83dee38 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Jun 07 13:04:18.575780 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:18.642726 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-f59162f0-0abc-4b40-8f56-1bbe185a9b9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "ram": 256}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:18.660970 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:04:18.660970 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: warnings.warn(msg) Jun 07 13:04:18.689444 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-f59162f0-0abc-4b40-8f56-1bbe185a9b9a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106467 Jun 07 13:04:18.690004 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:18.704652 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_api:SELECT=3 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:18.705927 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_cell0:SELECT=3 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:18.706651 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_cell1:SELECT=3 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:18.707359 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:04:18.910997 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-b6a64b91-6eb9-4672-b8bc-661d15063212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:18.913455 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:04:18.913455 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:04:18.982180 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-b6a64b91-6eb9-4672-b8bc-661d15063212 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283339 Jun 07 13:04:18.982765 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jun 7 13:04:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:21.304131 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-f59162f0-0abc-4b40-8f56-1bbe185a9b9a admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:21.305187 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-f59162f0-0abc-4b40-8f56-1bbe185a9b9a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 07 13:04:21.305599 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:21.412984 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-f5d2d991-2312-4418-9b8f-5391ebc079bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:21.430502 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:04:21.430502 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:04:21.449818 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-f5d2d991-2312-4418-9b8f-5391ebc079bf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138194 Jun 07 13:04:21.450374 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:04:21.462479 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-9c5f8325-10eb-47a4-b324-b4da821d01ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:21.463944 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:04:21.463944 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: warnings.warn(msg) Jun 07 13:04:21.496050 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-9c5f8325-10eb-47a4-b324-b4da821d01ae admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037256 Jun 07 13:04:21.496631 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jun 7 13:04:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:04:23.778170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-f5d2d991-2312-4418-9b8f-5391ebc079bf admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:23.779288 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-f5d2d991-2312-4418-9b8f-5391ebc079bf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jun 07 13:04:23.779844 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:23.845605 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-98dcae9d-5f27-4750-b0c6-aa6c5d22d943 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:23.866170 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-98dcae9d-5f27-4750-b0c6-aa6c5d22d943 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080377 Jun 07 13:04:23.867223 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:23.878978 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-2dd92acf-85e3-454c-a53c-290981699164 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:23.905041 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-2dd92acf-85e3-454c-a53c-290981699164 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029740 Jun 07 13:04:23.906146 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jun 7 13:04:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:26.193460 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-98dcae9d-5f27-4750-b0c6-aa6c5d22d943 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:26.194615 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-98dcae9d-5f27-4750-b0c6-aa6c5d22d943 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jun 07 13:04:26.195107 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:26.263959 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-deb717fe-d723-4220-95c2-49758c0b2054 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "disk": 10, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:26.285911 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-deb717fe-d723-4220-95c2-49758c0b2054 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079114 Jun 07 13:04:26.287079 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:26.299386 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-8fb5155d-990d-469c-951b-91b975e4f6c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:26.325394 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-8fb5155d-990d-469c-951b-91b975e4f6c1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029962 Jun 07 13:04:26.325905 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jun 7 13:04:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:28.675414 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-deb717fe-d723-4220-95c2-49758c0b2054 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:28.676430 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-deb717fe-d723-4220-95c2-49758c0b2054 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 07 13:04:28.676831 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:28.740423 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "disk": 20}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:28.761189 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077626 Jun 07 13:04:28.762185 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:28.774593 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-61f26615-0263-4920-baac-9da0731fc144 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:28.799037 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-61f26615-0263-4920-baac-9da0731fc144 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028229 Jun 07 13:04:28.799608 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jun 7 13:04:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:31.234377 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:31.235591 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002333 Jun 07 13:04:31.236104 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:31.298964 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-1195c790-8c0a-4144-81ea-f9e9231ebd85 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:31.323828 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-1195c790-8c0a-4144-81ea-f9e9231ebd85 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081390 Jun 07 13:04:31.324667 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jun 7 13:04:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:04:33.640273 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:33.641728 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-68cbe500-7d8f-4347-95d2-d0368e4e363d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Jun 07 13:04:33.642311 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:33.717238 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-a1ab5ba0-a7ef-499f-ab6b-927260f200d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:33.744961 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-a1ab5ba0-a7ef-499f-ab6b-927260f200d9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.096486 Jun 07 13:04:33.745880 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:33.767892 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-aade278d-536e-4818-8273-8024090f1b65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:33.803027 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-aade278d-536e-4818-8273-8024090f1b65 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045894 Jun 07 13:04:33.804019 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jun 7 13:04:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:36.407556 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-a1ab5ba0-a7ef-499f-ab6b-927260f200d9 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:36.408691 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-a1ab5ba0-a7ef-499f-ab6b-927260f200d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jun 07 13:04:36.409136 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:36.477072 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-d37bc7cb-64b4-4a62-a48a-cb6949861d02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:36.497767 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-d37bc7cb-64b4-4a62-a48a-cb6949861d02 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082152 Jun 07 13:04:36.498368 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:36.511712 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-667f60cc-e709-4fd9-bd2d-c5cd97325832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:36.537272 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-667f60cc-e709-4fd9-bd2d-c5cd97325832 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029746 Jun 07 13:04:36.537877 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jun 7 13:04:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:38.852396 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-d37bc7cb-64b4-4a62-a48a-cb6949861d02 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:38.853560 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-d37bc7cb-64b4-4a62-a48a-cb6949861d02 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jun 07 13:04:38.854061 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:38.912459 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-61f503f3-5a35-4eae-8faa-58c202cd364e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:38.932751 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-61f503f3-5a35-4eae-8faa-58c202cd364e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072734 Jun 07 13:04:38.933327 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:38.945320 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-99125437-9c74-41c8-b17f-296a21b65ee4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:38.969642 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-99125437-9c74-41c8-b17f-296a21b65ee4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028201 Jun 07 13:04:38.977054 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jun 7 13:04:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:41.251864 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-61f503f3-5a35-4eae-8faa-58c202cd364e admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:41.252938 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-61f503f3-5a35-4eae-8faa-58c202cd364e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 07 13:04:41.253361 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:41.310495 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-fa78af10-efe2-41ef-9e26-59bcfc64d914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:41.332723 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-fa78af10-efe2-41ef-9e26-59bcfc64d914 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072621 Jun 07 13:04:41.333330 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:04:41.345701 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-44c34e41-7a88-4476-ae17-4678961d1fa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:41.375626 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-44c34e41-7a88-4476-ae17-4678961d1fa5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034220 Jun 07 13:04:41.376719 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jun 7 13:04:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:04:43.729189 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-fa78af10-efe2-41ef-9e26-59bcfc64d914 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:04:43.730227 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-fa78af10-efe2-41ef-9e26-59bcfc64d914 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jun 07 13:04:43.730631 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:04:43.792141 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "id": "5", "vcpus": 8, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:43.813065 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076451 Jun 07 13:04:43.813909 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jun 7 13:04:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:04:43.825691 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-53286f8e-5ac3-4d26-abeb-dc3c0c5ef7ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:04:43.851567 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-53286f8e-5ac3-4d26-abeb-dc3c0c5ef7ff admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029294 Jun 07 13:04:43.852817 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jun 7 13:04:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:05:07.968351 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:07.969413 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 07 13:05:07.969817 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:07.980713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:08.034810 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-95141fea-785f-4868-8589-49013c776e28 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:08.054994 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-95141fea-785f-4868-8589-49013c776e28 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078933 Jun 07 13:05:08.055519 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jun 7 13:05:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:09.051043 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:09.052049 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-d55b5e00-798d-4d1f-b2d3-54ba8f8dc89b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 07 13:05:09.052454 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:09.257411 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e671368b-ff13-4684-a43d-9fb4e4daad13 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:09.263414 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.wsgi [None req-e671368b-ff13-4684-a43d-9fb4e4daad13 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e671368b-ff13-4684-a43d-9fb4e4daad13 admin admin] Request method failure captured: Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept: application/json Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept-Encoding: gzip, deflate Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Connection: keep-alive Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Content-Length: 0 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Host: 10.222.0.20 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-System-Scope: None Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: User-Agent: python-novaclient Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Auth-Token: gAAAAABin00FhMD3YCdD-X9vE1TEXNHDVoleeZejcLxZVuqwfXZ4DD3S4ZNugnnwsNagZqPbrZi6lw85Vd6BlwWfSCVU9y1PCkZsy81FIVQkj4GNseDTdJvShv5t_j4FlVU-RqWRG3ikEE6Xaw2hIPWbYcl53JKJnxVvnSf1Kj1k8EtQ5YvuBA0 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Id: None Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Name: None Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Identity-Status: Confirmed Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Is-Admin-Project: True Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Id: default Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Name: Default Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Name: admin Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Role: admin,reader,member Jun 07 13:05:09.267219 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Roles: admin,reader,member Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant: admin Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Name: admin Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User: admin Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Id: default Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Name: Default Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Name: admin Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: method: > Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: exception: Flavor 42 could not be found. Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: action_args: {'id': '42'} Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:09.268713 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:09.269652 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.270948 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e671368b-ff13-4684-a43d-9fb4e4daad13 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:09.271992 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-e671368b-ff13-4684-a43d-9fb4e4daad13 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069979 Jun 07 13:05:09.271992 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jun 7 13:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:09.279372 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-43893e1e-aa14-4b5f-83da-cf452298f3b4 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:09.282447 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:05:09.303675 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-43893e1e-aa14-4b5f-83da-cf452298f3b4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028053 Jun 07 13:05:09.304220 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:09.320904 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e6fbc03b-00ca-46fe-851b-598a9474b445 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:09.342253 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-e6fbc03b-00ca-46fe-851b-598a9474b445 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025012 Jun 07 13:05:09.342804 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:09.353122 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-47a29e63-e29b-4361-a583-34467aa9ceb7 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:09.359827 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.wsgi [None req-47a29e63-e29b-4361-a583-34467aa9ceb7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-47a29e63-e29b-4361-a583-34467aa9ceb7 admin admin] Request method failure captured: Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept: application/json Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept-Encoding: gzip, deflate Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Connection: keep-alive Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Content-Length: 0 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Host: 10.222.0.20 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-System-Scope: None Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: User-Agent: python-novaclient Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Auth-Token: gAAAAABin00FhMD3YCdD-X9vE1TEXNHDVoleeZejcLxZVuqwfXZ4DD3S4ZNugnnwsNagZqPbrZi6lw85Vd6BlwWfSCVU9y1PCkZsy81FIVQkj4GNseDTdJvShv5t_j4FlVU-RqWRG3ikEE6Xaw2hIPWbYcl53JKJnxVvnSf1Kj1k8EtQ5YvuBA0 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Id: None Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Name: None Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Identity-Status: Confirmed Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Is-Admin-Project: True Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Id: default Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Name: Default Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Name: admin Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Role: admin,reader,member Jun 07 13:05:09.363125 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Roles: admin,reader,member Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant: admin Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Name: admin Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User: admin Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Id: default Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Name: Default Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Name: admin Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: method: > Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: exception: Flavor 42 could not be found. Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: action_args: {'id': '42'} Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:09.364362 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:09.365257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:09.366517 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-47a29e63-e29b-4361-a583-34467aa9ceb7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:09.367758 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-47a29e63-e29b-4361-a583-34467aa9ceb7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015781 Jun 07 13:05:09.367758 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jun 7 13:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:10.239052 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e6fbc03b-00ca-46fe-851b-598a9474b445 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:10.240087 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-e6fbc03b-00ca-46fe-851b-598a9474b445 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 07 13:05:10.240463 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:10.438492 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-c3b46cef-eb2b-47af-ab69-cc03fdc30d9f admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:10.443894 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.wsgi [None req-c3b46cef-eb2b-47af-ab69-cc03fdc30d9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-c3b46cef-eb2b-47af-ab69-cc03fdc30d9f admin admin] Request method failure captured: Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept: application/json Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept-Encoding: gzip, deflate Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Connection: keep-alive Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Content-Length: 0 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Host: 10.222.0.20 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-System-Scope: None Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: User-Agent: python-novaclient Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Auth-Token: gAAAAABin00GU6HRmNQV3jolh7kpgbIexqOpEHNJo5oU4uoHqRBimbJXu4lGb-4jL81MYxFB9XZg42_BmRq52z7wvbe_K5zBI9tGoETrwViveWje1FrBE8fdaOAhFT402iQLCVrujejtlDrD5LaeALkD1PswvNLzt79vBQ6AYJLbkc8jH1-6Wbc Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Id: None Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Name: None Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Identity-Status: Confirmed Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Is-Admin-Project: True Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Id: default Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Name: Default Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Name: admin Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Role: admin,reader,member Jun 07 13:05:10.445442 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Roles: admin,reader,member Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant: admin Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Name: admin Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User: admin Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Id: default Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Name: Default Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Name: admin Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: method: > Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: exception: Flavor 84 could not be found. Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: action_args: {'id': '84'} Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:10.446736 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:10.447767 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.449137 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-c3b46cef-eb2b-47af-ab69-cc03fdc30d9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:10.450475 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-c3b46cef-eb2b-47af-ab69-cc03fdc30d9f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070702 Jun 07 13:05:10.450475 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jun 7 13:05:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:10.457414 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-0e2de112-cd46-4e04-abbc-5d2f9688acf9 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:10.471241 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-0e2de112-cd46-4e04-abbc-5d2f9688acf9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017529 Jun 07 13:05:10.471774 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:10.481072 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-7d62978d-eaec-4d7b-9b4f-96ac014fa1bc admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:10.497354 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-7d62978d-eaec-4d7b-9b4f-96ac014fa1bc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019382 Jun 07 13:05:10.498191 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:05:10.507721 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e419fc12-e390-4b07-b033-495f6f9f831a admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:10.513345 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.wsgi [None req-e419fc12-e390-4b07-b033-495f6f9f831a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e419fc12-e390-4b07-b033-495f6f9f831a admin admin] Request method failure captured: Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept: application/json Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept-Encoding: gzip, deflate Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Connection: keep-alive Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Content-Length: 0 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Host: 10.222.0.20 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-System-Scope: None Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: User-Agent: python-novaclient Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Auth-Token: gAAAAABin00GU6HRmNQV3jolh7kpgbIexqOpEHNJo5oU4uoHqRBimbJXu4lGb-4jL81MYxFB9XZg42_BmRq52z7wvbe_K5zBI9tGoETrwViveWje1FrBE8fdaOAhFT402iQLCVrujejtlDrD5LaeALkD1PswvNLzt79vBQ6AYJLbkc8jH1-6Wbc Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Id: None Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Name: None Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Identity-Status: Confirmed Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Is-Admin-Project: True Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Id: default Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Name: Default Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Name: admin Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Role: admin,reader,member Jun 07 13:05:10.515314 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Roles: admin,reader,member Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant: admin Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Name: admin Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User: admin Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Id: default Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Name: Default Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Name: admin Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: method: > Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: exception: Flavor 84 could not be found. Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: action_args: {'id': '84'} Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:10.516883 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:10.517796 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:10.518924 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-e419fc12-e390-4b07-b033-495f6f9f831a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:10.519877 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-e419fc12-e390-4b07-b033-495f6f9f831a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012622 Jun 07 13:05:10.519877 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jun 7 13:05:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:11.380894 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-7d62978d-eaec-4d7b-9b4f-96ac014fa1bc admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:11.383181 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-7d62978d-eaec-4d7b-9b4f-96ac014fa1bc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003284 Jun 07 13:05:11.384062 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:11.596484 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-416e2f92-bf2c-454f-8dbd-eab3e77e7324 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:11.602571 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.wsgi [None req-416e2f92-bf2c-454f-8dbd-eab3e77e7324 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-416e2f92-bf2c-454f-8dbd-eab3e77e7324 admin admin] Request method failure captured: Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept: application/json Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Accept-Encoding: gzip, deflate Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Connection: keep-alive Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Content-Length: 0 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Host: 10.222.0.20 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Openstack-System-Scope: None Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: User-Agent: python-novaclient Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Auth-Token: gAAAAABin00HfB4VLk6SeB3YFkUVgNUyyG4gqMl94VTtTODeecmwYEQwto8mm1rfKIP5JSN8AIrIJYHVOKgdoI89nwf-aHiVF7NZ6NbyRVnCIY_is4TQ-SSM9rTEeaRPGU9WCUFHUratcWVq08a-8g3mJZ_pD1ZE47v-Pf1kA6Dg7EhRnfdFL00 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Id: None Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Domain-Name: None Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Identity-Status: Confirmed Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Is-Admin-Project: True Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Id: default Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Domain-Name: Default Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Project-Name: admin Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Role: admin,reader,member Jun 07 13:05:11.604154 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Roles: admin,reader,member Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant: admin Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-Tenant-Name: admin Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User: admin Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Id: default Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Domain-Name: Default Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: X-User-Name: admin Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: method: > Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: exception: Flavor 451 could not be found. Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: action_args: {'id': '451'} Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:11.605486 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:11.606478 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.607650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-416e2f92-bf2c-454f-8dbd-eab3e77e7324 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:11.608910 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-416e2f92-bf2c-454f-8dbd-eab3e77e7324 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.085044 Jun 07 13:05:11.608910 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:05:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:11.617541 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-eca73e64-d8a8-4bac-b27a-0cd2b81df559 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:11.633711 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-eca73e64-d8a8-4bac-b27a-0cd2b81df559 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020883 Jun 07 13:05:11.634533 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:11.645034 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:11.659106 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017709 Jun 07 13:05:11.659650 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jun 7 13:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:05:11.670555 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-b03f72a9-cd64-4c64-9bfc-ee8849cdc570 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:11.677053 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.wsgi [None req-b03f72a9-cd64-4c64-9bfc-ee8849cdc570 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-b03f72a9-cd64-4c64-9bfc-ee8849cdc570 admin admin] Request method failure captured: Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept: application/json Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Accept-Encoding: gzip, deflate Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Connection: keep-alive Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Content-Length: 0 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Host: 10.222.0.20 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-Api-Version: compute 2.90 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Openstack-System-Scope: None Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: User-Agent: python-novaclient Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Auth-Token: gAAAAABin00HfB4VLk6SeB3YFkUVgNUyyG4gqMl94VTtTODeecmwYEQwto8mm1rfKIP5JSN8AIrIJYHVOKgdoI89nwf-aHiVF7NZ6NbyRVnCIY_is4TQ-SSM9rTEeaRPGU9WCUFHUratcWVq08a-8g3mJZ_pD1ZE47v-Pf1kA6Dg7EhRnfdFL00 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Id: None Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Domain-Name: None Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Identity-Status: Confirmed Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Is-Admin-Project: True Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Id: default Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Domain-Name: Default Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Project-Name: admin Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Role: admin,reader,member Jun 07 13:05:11.679244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Roles: admin,reader,member Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebd193fab79b438b93f957ec4ee6cab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant: admin Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Id: ebd193fab79b438b93f957ec4ee6cab4 Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-Tenant-Name: admin Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User: admin Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Id: default Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Domain-Name: Default Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Id: f8993b31c1f849d2899564c3495501c1 Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: X-User-Name: admin Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: method: > Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: exception: Flavor 451 could not be found. Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: action_args: {'id': '451'} Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:05:11.680802 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:11.681814 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: ERROR nova.api.openstack.wsgi Jun 07 13:05:11.683170 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-b03f72a9-cd64-4c64-9bfc-ee8849cdc570 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:05:11.684431 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-b03f72a9-cd64-4c64-9bfc-ee8849cdc570 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015465 Jun 07 13:05:11.684431 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:05:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 13:05:12.579034 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:12.580073 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 07 13:05:12.580472 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:12.777183 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-8441ec5c-2cb4-4a82-9d17-3220cbab46e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:05:12.797876 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-8441ec5c-2cb4-4a82-9d17-3220cbab46e5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081598 Jun 07 13:05:12.798426 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jun 7 13:05:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:05:13.660361 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:13.661480 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 07 13:05:13.661889 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:13.858843 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-198da04f-d659-41e8-9e42-9469a2036430 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:05:13.885905 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-198da04f-d659-41e8-9e42-9469a2036430 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087746 Jun 07 13:05:13.886430 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jun 7 13:05:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:05:14.812059 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:14.813091 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 07 13:05:14.813517 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:15.016445 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-da848a2e-b46f-47ca-8538-a1627abfc560 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:05:15.036532 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-da848a2e-b46f-47ca-8538-a1627abfc560 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087275 Jun 07 13:05:15.037069 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jun 7 13:05:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:05:15.914662 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:15.916037 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Jun 07 13:05:15.916595 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:16.124405 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-51ed52d8-d615-40c9-ae4b-06dd1dccaf75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:05:16.150111 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-51ed52d8-d615-40c9-ae4b-06dd1dccaf75 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.092745 Jun 07 13:05:16.150764 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jun 7 13:05:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:05:17.050815 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:17.051831 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 07 13:05:17.052226 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:05:17.247922 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-ac48419e-73c4-47e4-9dbd-4fde9b6bdfa2 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:05:17.268033 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-ac48419e-73c4-47e4-9dbd-4fde9b6bdfa2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080599 Jun 07 13:05:17.268574 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Jun 7 13:05:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:06:18.609186 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.610204 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-b0ffe23a-11d8-434a-bc96-898c146cee6b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Jun 07 13:06:18.610846 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:06:18.618426 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:18.675700 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-9cd11c61-f8ba-4295-b091-d063175fcf6d admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.695300 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-9cd11c61-f8ba-4295-b091-d063175fcf6d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078294 Jun 07 13:06:18.695867 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:06:18.716875 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG dbcounter [-] [103429] Writing DB stats nova_api:SELECT=14 {{(pid=103429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:06:18.720587 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-2ba1f811-5488-4fb9-b44c-5546b2d48c2d admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.729080 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-2ba1f811-5488-4fb9-b44c-5546b2d48c2d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013586 Jun 07 13:06:18.729871 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:18.741952 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-4e01f483-a09a-46c8-9248-a7315caf8fb7 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.750461 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-4e01f483-a09a-46c8-9248-a7315caf8fb7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012162 Jun 07 13:06:18.751006 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:06:18.763377 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.771622 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012444 Jun 07 13:06:18.772202 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:06:18.784388 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-c80f8f04-ef01-47fe-9eb1-a2aa6a4bf2bb admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:06:18.792860 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-c80f8f04-ef01-47fe-9eb1-a2aa6a4bf2bb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012099 Jun 07 13:06:18.793432 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jun 7 13:06:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:09:43.004783 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:43.006228 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jun 07 13:09:43.006726 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:09:43.162462 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_api:SELECT=6 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:09:43.292225 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:43.293406 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:09:43.293406 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:09:43.294606 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:43.295042 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:43.295820 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:43.296244 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:43.330198 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-740edb95-9c0b-443b-b806-45752438ec64 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.170601 Jun 07 13:09:43.330759 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:09:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:09:44.220000 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:44.221685 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002242 Jun 07 13:09:44.222340 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:09:44.425859 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:44.427019 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:09:44.427019 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:09:44.428172 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:44.428633 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:44.429424 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:44.429846 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:44.449253 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-5a4fda97-b111-4ff2-b7aa-34e671be9f54 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083288 Jun 07 13:09:44.449825 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:09:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:09:55.826506 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:55.827525 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 07 13:09:55.827923 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:09:55.980228 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_cell0:SELECT=4 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:09:55.981257 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_cell1:SELECT=4 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:09:55.982070 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG dbcounter [-] [103430] Writing DB stats nova_api:SELECT=8 {{(pid=103430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:09:56.047149 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:56.048924 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:09:56.048924 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:09:56.050709 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:56.051369 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:56.052643 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:56.053213 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:56.081392 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-6c33a9e2-3107-4457-93c5-d7faa65fedf1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.107915 Jun 07 13:09:56.081960 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:09:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:09:56.988632 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: DEBUG nova.api.openstack.wsgi [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] Calling method '>' {{(pid=103429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:56.990013 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: INFO nova.api.openstack.requestlog [None req-dac16393-6fc6-4bc9-b9b9-7f9357b22f74 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jun 07 13:09:56.990559 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: [pid: 103429|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jun 7 13:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:09:57.192106 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG nova.api.openstack.wsgi [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] Calling method '>' {{(pid=103430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:09:57.193315 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 13:09:57.193315 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: warnings.warn(msg) Jun 07 13:09:57.194566 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:57.194938 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:57.195839 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:09:57.196301 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: DEBUG oslo_concurrency.lockutils [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:09:57.219164 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: INFO nova.api.openstack.requestlog [None req-d5002d4a-6090-4d09-9be9-931fc1780f0d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090184 Jun 07 13:09:57.219679 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: [pid: 103430|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jun 7 13:09:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:10:55.863742 dv-cinder-844962-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 13:10:55.864322 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: Tue Jun 7 13:10:55 2022 - graceful shutdown triggered... Jun 07 13:10:55.864777 dv-cinder-844962-1-iscsi devstack@n-api.service[103430]: Gracefully killing worker 2 (pid: 103430)... Jun 07 13:10:55.865170 dv-cinder-844962-1-iscsi devstack@n-api.service[103429]: Gracefully killing worker 1 (pid: 103429)... Jun 07 13:10:56.865675 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: worker 1 buried after 1 seconds Jun 07 13:10:56.865675 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: worker 2 buried after 1 seconds Jun 07 13:10:56.865675 dv-cinder-844962-1-iscsi devstack@n-api.service[103428]: goodbye to uWSGI. Jun 07 13:10:56.867622 dv-cinder-844962-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 13:10:56.868413 dv-cinder-844962-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 13:10:56.871868 dv-cinder-844962-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 13:10:56.886914 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 13:10:56 2022] *** Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: nodename: dv-cinder-844962-1-iscsi Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: machine: x86_64 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: clock source: unix Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: pcre jit disabled Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: detected number of CPU cores: 4 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: current working directory: / Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: detected binary path: /usr/bin/uwsgi-core Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: your processes number limit is 47680 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: your memory page size is 4096 bytes Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: detected max file descriptor number: 2048 Jun 07 13:10:56.910471 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: lock engine: pthread robust mutexes Jun 07 13:10:56.911576 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: thunder lock: enabled Jun 07 13:10:56.911576 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 13:10:56.911576 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 13:10:56.961541 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: Python main interpreter initialized at 0x55a7a3d6d9c0 Jun 07 13:10:56.961541 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: python threads support enabled Jun 07 13:10:56.961541 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: your server socket listen backlog is limited to 100 connections Jun 07 13:10:56.961541 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: your mercy for graceful operations on workers is 90 seconds Jun 07 13:10:56.962014 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 13:10:56.962014 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: *** Operational MODE: preforking *** Jun 07 13:10:56.962270 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: *** uWSGI is running in multiple interpreter mode *** Jun 07 13:10:56.962270 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: spawned uWSGI master process (pid: 117813) Jun 07 13:10:56.962500 dv-cinder-844962-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 13:10:56.963116 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: spawned uWSGI worker 1 (pid: 117832, cores: 1) Jun 07 13:10:56.965847 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: spawned uWSGI worker 2 (pid: 117833, cores: 1) Jun 07 13:10:56.965847 dv-cinder-844962-1-iscsi devstack@n-api.service[117813]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 13:10:58.216565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:10:58.217228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 13:10:59.034970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:10:59.034970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Jun 07 13:10:59.035267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:10:59.035267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes Jun 07 13:10:59.035413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:10:59.035413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: from cryptography.utils import int_from_bytes Jun 07 13:10:59.035923 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 13:10:59.035923 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: from cryptography.utils import int_from_bytes Jun 07 13:11:01.367825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:11:01.368834 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:11:01.369366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:11:01.369785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:11:01.370020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:11:01.370404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.370728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.371018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.371336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.371694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.372005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.372284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.372635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.372957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.373228 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.373556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.373937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-1-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.374191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.374494 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.374803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.375115 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.375538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.375863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.376291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.376789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.378247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.378247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.378247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.378516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.379134 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.379440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.379762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.380082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.380204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 13:11:01.380668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.380755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 13:11:01.380837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.381126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 13:11:01.381346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-1-iscsi {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.381592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.381837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 13:11:01.381837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 13:11:01.382264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.382264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.382668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.382668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.383050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.383280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.383493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.383706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.383914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.384123 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.384322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.384545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.384759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.384943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.385990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386614 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844962-1-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.386914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387065 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387511 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.387975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388129 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388271 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388419 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388713 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.388862 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389003 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389379 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.389989 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.390162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.390316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.390591 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.390748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.390942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.391989 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392282 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.392883 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844962-1-iscsi {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393665 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.393988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394137 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394581 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394733 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.394881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.395797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.400255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.400446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.400621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.400779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.400928 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.401916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.402110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.402263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.403590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.403756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.403904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.404967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.405875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.406046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.406236 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.406236 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.408431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.408604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.408765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.408765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.409649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.409799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.409940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410090 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410396 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410538 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.410980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.411137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.411279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412844 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.412962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.414892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.415920 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.416458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.417652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.418916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.419680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.420759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.421061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.421222 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.421437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.421777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.421927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.422069 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.422069 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.422733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.422980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.423132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.423307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.423493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.423620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.423731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.423847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.423958 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.424065 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.424182 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.424333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.424464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.424579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.424696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.424806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.424923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.425053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.425053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.425274 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.425361 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.425458 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.425458 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.425661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.425786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.425886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.425886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.426191 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.426318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.426437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.426548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.426676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.426803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.426943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.427070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.427180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.427288 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.427403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.427513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.427630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.427741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.427848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.427963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.428080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.428217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.428711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.428902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.429088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.429338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.429486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.429630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.429822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.429953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.430083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.430237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.430449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.430594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.430685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.430932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.431094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.431255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.431526 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.431995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.431995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.432374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.432501 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.432627 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.432754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.432878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.432966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.433171 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433265 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.433939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.434192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.434370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.434533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.434719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.435481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.436871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.437243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.437243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.437585 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.438146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.438801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.438920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.439240 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.439556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.439860 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.440170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.440473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.440779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.441178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.441485 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.441652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.441799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.442127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.442292 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.442452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.442634 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.442790 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.442934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.442934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.443201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.443342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.443497 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.443639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.443786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.443934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.444094 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.444245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.444398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.444539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.444686 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.444828 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.444968 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.445194 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.445347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.445598 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.445753 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.445901 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.446275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.446605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.446776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.446919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.447058 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.447267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.447514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.447891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.448044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.448044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.448353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.448499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.448791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.449119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.449305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.449482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.449624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.449764 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.449913 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.450062 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 13:11:01.450212 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.450405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.450582 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.450739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.450882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.451120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.451454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.451454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.451733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.451889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.452978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.453284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.453870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.454960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455563 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.455889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.456911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.457285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.457428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.457577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.457726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.457875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.458885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.459961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.460858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.461868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462012 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462188 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.462978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463137 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463289 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.463881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464024 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464310 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.464898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.465277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.465429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.465577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.465719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.465873 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466643 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.466938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467667 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.467955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.468102 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.468243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.468393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.468545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.468764 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.469993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.470315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.470463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.470686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.470885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471458 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.471992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.472142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.472298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.472468 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.472782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.472928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.473859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474149 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.474894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475489 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.475927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476801 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.476953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.477278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.477436 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.477591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.477742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.477883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.478921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.479160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.479307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.479478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.479786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.479937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480217 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.480929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.481171 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.481334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.481485 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.481634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.482075 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.482229 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.482415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.482572 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.482884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483203 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483487 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483790 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.483938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.484922 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485232 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.485972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486266 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.486835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.487987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488136 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488425 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.488860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.489165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.489165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.489814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490210 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.490945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.491085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.491085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.491419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.491792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.492038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.492224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.492425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.492577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.492727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.493967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494751 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.494900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495041 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.495982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.496897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.497510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.497664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.497806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.497956 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.498884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499027 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499325 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.499718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.500163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.500427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.500623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.500787 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.500937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501422 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501599 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501750 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.501895 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502563 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.502901 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.503212 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.503362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.503362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.504862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.505895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.506830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.506939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507194 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507267 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507857 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.507941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508013 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508089 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508230 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508521 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508902 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.508978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.509081 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.509155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.509224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.509376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.519723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.519957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.519957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.520399 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.520728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.520875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521248 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.521847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.522875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523451 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.523964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.524125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.524275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.524432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.524607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.524859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525073 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.525907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.526978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.527139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.527389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.527544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.527702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.527851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528032 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528503 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528660 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.528963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.529268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.529441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.529610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.529785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530007 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530338 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530503 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.530810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531102 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531252 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531817 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.531977 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.532984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.533358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.533664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.533823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.533983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534425 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534581 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.534874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535030 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.535943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.536133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.536286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.536442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.536591 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.536747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537006 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537210 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.537939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.538920 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539534 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.539838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.540023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.540259 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.540581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.540733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.540881 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541248 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541434 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.541900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542054 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.542907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.543075 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.543237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.543386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.543690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.543857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544202 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544363 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544660 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.544984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545338 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545787 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.545936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546450 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.546921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.547236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.547464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.547647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.547898 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548826 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.548981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.549185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.549378 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.549560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.549712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.549867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.550022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.550279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.550639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.550796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.550953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.551888 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.552241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.553543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.553866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554030 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554380 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554534 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554829 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.554975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.555890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556777 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.556955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.557794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.557971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.558745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559330 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.559796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.560193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.560384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.560800 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.560969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561357 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561526 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.561974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562292 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.562479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564060 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.564992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.565335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.565505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.565662 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.565821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.565978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.566886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.567816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568092 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568570 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.568967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.570156 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.570310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.570459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.570622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.570622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.571185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.571344 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.571721 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.571881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572194 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572341 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.572652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.573228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.573538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.573637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.573795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.573886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574007 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574477 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.574999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575160 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.575932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.576931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577542 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577713 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577811 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.577985 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578271 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.578957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579139 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.579920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580013 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.580548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.581430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.582947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.583971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584053 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584643 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.584987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585526 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.585960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586399 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.586794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587763 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.587983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.588147 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.588403 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.588547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.588659 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.588785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.589834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.590603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.591385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.591539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.591662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.591787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.591903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592027 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592265 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.592945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593149 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593250 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593325 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593540 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.593909 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.594239 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.594356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.594681 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.594789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595354 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.595867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596037 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596293 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.596935 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.597949 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598556 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.598954 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599595 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.599911 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600720 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.600840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.601852 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602531 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.602987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.603098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.603228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.603353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.603676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.603984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.604296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.604617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.604928 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.605257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.605567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.606053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.606193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.606473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.606774 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.607075 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.607382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.607884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.608060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.608238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.608571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.608840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.609168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.609337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.609495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.609679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.609854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.610122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.610274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.610522 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.610678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.611563 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.611698 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.611840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.611981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612137 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.612946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613315 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613581 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613681 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.613940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.614251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.614355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.614557 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.614652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.614887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615040 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.615812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616008 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616417 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.616987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617741 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.617962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618059 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.618909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.619950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620161 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620265 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.620881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621112 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621220 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.621834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622226 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622707 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.622803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.623776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.624009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.624168 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.624352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.624642 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.624934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625214 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625714 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.625988 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:11:01.626088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.626351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.626675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.626997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.627318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.627639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.627962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.628282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.628978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.629456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.629792 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.630138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.630462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.630785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.631107 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.631426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.631790 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.632111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.632422 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.632750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.633083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.633404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.633720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.634070 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.634355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.634672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.634995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.635308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.635623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.635939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.636266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.636601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.636927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.637268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.637587 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.637904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.638429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.638749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.639084 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.639413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.639743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.640064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.640387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.640721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.641112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.641426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.641741 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.642055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.642362 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.642688 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.643004 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.643311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.643633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.643946 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.644490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.644845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.645192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.645519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.645847 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.646170 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.646481 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.646806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.647117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.647424 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.647740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.648053 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.648359 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.648666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.648979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.649357 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.649663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.649975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.650307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.650637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.650946 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.651257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.651565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.651877 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.652183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.652489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.652796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.653148 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.653496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.653806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.654123 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.654431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.654739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.655045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.655358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.655711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.656035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.656339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.656743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.657114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.657429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.657756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.658073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.658384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.658736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.659057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.659594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.659937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.660266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.660606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.660945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.661287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.661597 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.661905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.662234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.662551 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.662867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.663180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.663491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.663803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.664122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.664435 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.664745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.665126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.665387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.665697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.666011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.666325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.666641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.666982 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.667302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.667620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.667938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.668257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.668569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.668878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.669213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.669523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.669838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.670164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.670480 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.670785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.671216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.671529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.671882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.672246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.672678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.673003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.673352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.673669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.674003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.674317 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.674644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.674987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.675302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.675636 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.675942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.676248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.676549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.676860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.677206 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.677527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.677832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.678140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.678450 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.678745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.679052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.679359 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.679666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.680307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.680307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.680564 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.680870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.681374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.681872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.682255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.682611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.683038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.683225 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.683535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.683845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.684160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.684659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.684974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.685350 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.685680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.685997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.686135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Registered counter for database nova_api Jun 07 13:11:01.686437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.686845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.687211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.687543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.687951 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.688273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.688613 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.689196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.689532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.689853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.690173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.690491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.690806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.691140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.691474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.691788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.692116 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.692438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.692763 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.693105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.693420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.693754 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.694069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.694384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.694709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.695022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.695335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.695653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.695975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.696305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.696633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.696950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.697304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.697635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.697993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.698340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.698690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.699024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.699343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.699657 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.699968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 13:11:01.700216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 13:11:01.705951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.712583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.761429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Registered counter for database nova_api Jun 07 13:11:01.768827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.context [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af0611bb-ba94-47a7-9ba7-fca8b65e4503(cell1) {{(pid=117832) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:11:01.772961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:01.774684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:01.775496 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:01.777479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:01.779464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Registered counter for database nova_cell0 Jun 07 13:11:01.783018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.785275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Registered counter for database nova_cell1 Jun 07 13:11:01.792644 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.793630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.794787 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.799476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.802538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.850177 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.context [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af0611bb-ba94-47a7-9ba7-fca8b65e4503(cell1) {{(pid=117833) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 13:11:01.854354 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:01.855925 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:01.856729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:01.858710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:01.860785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Registered counter for database nova_cell0 Jun 07 13:11:01.866178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Registered counter for database nova_cell1 Jun 07 13:11:01.873712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.875079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.883773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.885383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:01.949211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO dbcounter [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Registered counter for database nova_cell0 Jun 07 13:11:01.956408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_db.sqlalchemy.engines [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:01.961392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writer thread running {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:02.033723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO dbcounter [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Registered counter for database nova_cell0 Jun 07 13:11:02.049695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_db.sqlalchemy.engines [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 13:11:02.053383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writer thread running {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 13:11:02.405455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:11:02.413348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:11:02.512166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:11:02.519706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:11:02.636139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:11:02.642364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: WARNING keystonemiddleware.auth_token [None req-4d535f9e-da07-4139-98ee-085ef644ca3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:11:02.647517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7a3d6d9c0 pid: 117832 (default app) Jun 07 13:11:02.741535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 13:11:02.747594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: WARNING keystonemiddleware.auth_token [None req-5a781fb3-3570-4484-bd98-f2b1e7ae5974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 13:11:02.752812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7a3d6d9c0 pid: 117833 (default app) Jun 07 13:11:44.845808 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.847658 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.848443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:44.851866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:46.088908 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f13a2086-e5cb-43a7-9ce2-f6af7576b940 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Action: 'create', calling method: .version_select at 0x7f20a66e65e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-807905010", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:47.902253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f13a2086-e5cb-43a7-9ce2-f6af7576b940 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.065097 Jun 07 13:11:47.903890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jun 7 13:11:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3070 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:11:48.465137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd848e0f-f98a-475e-9b7a-93a7e0662dcd tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Calling method '.version_select at 0x7f20a6965790>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:48.516730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:48.517941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:48.519520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:48.520412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:11:49.005774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bd848e0f-f98a-475e-9b7a-93a7e0662dcd tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a" status: 200 len: 353 microversion: 2.1 time: 1.091958 Jun 07 13:11:49.006369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:11:47 2022] GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a => generated 353 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:49.019582 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48c83c2e-464d-4f83-97b1-e8c4c3dac4a2 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Calling method '.version_select at 0x7f20a65af5e0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:49.339741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-48c83c2e-464d-4f83-97b1-e8c4c3dac4a2 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a" status: 200 len: 353 microversion: 2.1 time: 0.324250 Jun 07 13:11:49.365715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f5b6fad1-e110-43df-a503-7d61a804b470 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Calling method '.version_select at 0x7f20a65f4670>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:49.369882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:11:49 2022] GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a => generated 353 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:49.546496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f5b6fad1-e110-43df-a503-7d61a804b470 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a" status: 202 len: 0 microversion: 2.1 time: 0.190259 Jun 07 13:11:49.548385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:11:49 2022] DELETE /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:11:49.559959 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e3b2ed05-7ea0-4317-83ea-30188768b4d9 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Calling method '.version_select at 0x7f20a65af940>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:49.657178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e3b2ed05-7ea0-4317-83ea-30188768b4d9 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a" status: 200 len: 352 microversion: 2.1 time: 0.104486 Jun 07 13:11:49.658083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:11:49 2022] GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:11:50.176652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1345448660", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "networks": [{"uuid": "672e1b1d-f13b-470b-a24f-478fe0426ca6"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:11:50.441907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] validate_networks() for [('672e1b1d-f13b-470b-a24f-478fe0426ca6', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:11:50.681578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6cd01d6-c0dd-45fd-b8d9-feb246bb7a36 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Calling method '.version_select at 0x7f20a65afd30>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:50.745153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e6cd01d6-c0dd-45fd-b8d9-feb246bb7a36 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] HTTP exception thrown: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6cd01d6-c0dd-45fd-b8d9-feb246bb7a36 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Request method failure captured: Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a HTTP/1.1 Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06Q09VDLzaVKMXjtfeX5lgXcomt8yoRAgOhG_kAqHZVpD9I603KeKlNM9rPL3qZPK09CbK4QorUuk0RlVQ7u40LwxOkkp0PvPC6mF0AuNPgO8DkakcuC0yjC35INncIxyWQIDyTgtfw4_KAs-QUYh_bUPfPftI451O_ct7dS4VRq4Q Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 1a2b054728c147788d7a6f5b2b2645be Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesGetTestJSON-520243299 Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:11:50.757780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a2b054728c147788d7a6f5b2b2645be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a2b054728c147788d7a6f5b2b2645be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a2b054728c147788d7a6f5b2b2645be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a2b054728c147788d7a6f5b2b2645be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesGetTestJSON-520243299 Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 1a2b054728c147788d7a6f5b2b2645be Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesGetTestJSON-520243299 Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesGetTestJSON-520243299-project Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: f7389e6ff75a4cfbbdaf444906611f96 Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesGetTestJSON-520243299-project Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a7dbf17c-acac-4117-971f-10d4474e573a'} Jun 07 13:11:50.759167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. (HTTP 404) (Request-ID: req-90f83abe-c4f3-474b-bef4-c4415e4372ae) Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:50.759900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:11:50.760942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:11:50.761993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. Jun 07 13:11:50.763021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:11:50.764536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6cd01d6-c0dd-45fd-b8d9-feb246bb7a36 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] Returning 404 to user: Volume a7dbf17c-acac-4117-971f-10d4474e573a could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:11:50.767018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e6cd01d6-c0dd-45fd-b8d9-feb246bb7a36 tempest-VolumesGetTestJSON-520243299 tempest-VolumesGetTestJSON-520243299-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a" status: 404 len: 109 microversion: 2.1 time: 0.100433 Jun 07 13:11:50.767802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:11:50 2022] GET /compute/v2.1/os-volumes/a7dbf17c-acac-4117-971f-10d4474e573a => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:11:53.783934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:11:53.784445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:11:53.784728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:11:53.785263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:11:53.785676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:11:53.822787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:53.823507 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:53.824713 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:53.825350 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:53.878942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Getting quotas for project 3f90a27e69c7441ea20216b40281fdba. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:11:53.889576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Getting quotas for user bc103ff7fb9342179a7ce6404315afed and project 3f90a27e69c7441ea20216b40281fdba. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:11:53.914302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:11:53.918110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:11:54.093338 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-716cd0c2-df4c-478f-b179-e330c88665f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.185587 Jun 07 13:11:54.100893 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 3/7] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:11:54.107070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-081b1d8d-c50d-4f67-9284-07ab73846833 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:54.108179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-081b1d8d-c50d-4f67-9284-07ab73846833 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:11:54.416224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-081b1d8d-c50d-4f67-9284-07ab73846833 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:11:54.439415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-081b1d8d-c50d-4f67-9284-07ab73846833 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1215 microversion: 2.1 time: 0.338306 Jun 07 13:11:54.446210 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:11:54 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:11:55.462633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5ce6187f-53af-43d2-8e43-cc87d0c3d1f1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:55.463264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5ce6187f-53af-43d2-8e43-cc87d0c3d1f1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:11:55.908885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5ce6187f-53af-43d2-8e43-cc87d0c3d1f1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:11:55.957758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5ce6187f-53af-43d2-8e43-cc87d0c3d1f1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1215 microversion: 2.1 time: 0.504537 Jun 07 13:11:55.967087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:11:55 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1215 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:11:56.975284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:56.975991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:11:56.989213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:56.994135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:56.999145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:57.003078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:57.434943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:11:57.489056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a277c03f-af7a-44be-8acc-05d54dac9fec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1219 microversion: 2.1 time: 0.512492 Jun 07 13:11:57.492598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:11:56 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1219 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:11:58.509778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:11:58.511257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:11:58.534650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:58.535822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:58.539321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:11:58.540098 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:11:59.176039 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:11:59.247918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3c20b471-57f1-4689-9b32-4fdf7cc39557 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1285 microversion: 2.1 time: 0.743241 Jun 07 13:11:59.249278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:11:58 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1285 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:00.270414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:00.271164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:00.281800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:00.284375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:00.285497 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:00.286368 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:00.352328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1548956508", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:00.517715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:00.530920 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bb7e7ef5-c19a-4f7b-be38-00bf62be157a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1273 microversion: 2.1 time: 0.263976 Jun 07 13:12:00.549794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:00 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:00.605436 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] validate_networks() for [('a9e5d769-a2db-434e-aa7d-110535a28faa', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:12:01.782773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-56d52f3d-34a9-452f-a97a-a2c62b1f95db tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: .version_select at 0x7f20a53a7f70>, body: {"keypair": {"name": "tempest-keypair-376221652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7r2zEEL6/gH5WidBfMJsFyMLx7q10HAZftfQq4sp/WM8e73NAnHfH0tNL/QgqQ8PLCELMsEM7pcJsrzzQ1CPMwtMvM6g7vVG9/oag9lQ29NNujZf/RI7p3W9/AVuMImA=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:01.898449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-56d52f3d-34a9-452f-a97a-a2c62b1f95db tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for project 6c6b89da4e96480ba68652cff770b388. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:01.907847 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-56d52f3d-34a9-452f-a97a-a2c62b1f95db tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for user 8b341180925b454094d9bf5e6f5b3eaf and project 6c6b89da4e96480ba68652cff770b388. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:02.033977 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-56d52f3d-34a9-452f-a97a-a2c62b1f95db tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.165257 Jun 07 13:12:02.036093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 7/13] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jun 7 13:12:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 07 13:12:02.044537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:02.050246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:02.081409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:02.085296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:02.088699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:02.092242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:03.102392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:03.118881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-91ea50e5-c397-406f-9ce8-6d0600cbf3dc tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 1.081464 Jun 07 13:12:03.122465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:02 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:03.852218 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:03.864372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-371853ca-9b0b-4f66-ade5-9c08d34e4e80 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: .version_select at 0x7f20a5476430>, body: {"keypair": {"name": "tempest-keypair-1417849956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+czdihmlw6WxcPEs0oz8xRBKV6fDRusH8sYHmI/VCofBwXXxBB4/0dhZE1hzRr3V3/+TuXp13aVpdLOQfm4BbCI38LxChPIcqhOBTVGhaPRo93RHCM5W0GjnkqH6PeJQ=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:03.915367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-371853ca-9b0b-4f66-ade5-9c08d34e4e80 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:03.923717 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-371853ca-9b0b-4f66-ade5-9c08d34e4e80 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for user e1e6349a50ec4554b27b94b3f0f2dcbd and project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:03.996987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-371853ca-9b0b-4f66-ade5-9c08d34e4e80 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.872087 Jun 07 13:12:04.025509 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 9/15] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:12:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:04.152237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:04.155870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:04.168140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:04.168822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:04.169853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:04.170508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:04.431068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:05.014985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:12:05.015669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:12:05.016625 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:12:05.017339 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:12:05.018353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:12:05.085528 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:05.087639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:05.091395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:05.094391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:05.138794 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:05.148840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for user 025ca1d10d5e49e984c7fd4e0b425f08 and project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:05.164771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:12:05.168510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:12:05.369177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13690708-2e2f-44d2-8f47-031ed706602f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.970805 Jun 07 13:12:05.369698 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 7/16] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:11:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 5973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:12:05.381701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e2e225c-1ec2-4b8d-88d1-7c6ed08e4136 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:05.382467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e2e225c-1ec2-4b8d-88d1-7c6ed08e4136 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:05.449471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:05.457645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f4bfc96e-55d0-480e-899b-76f3c52ba9db tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 1.313668 Jun 07 13:12:05.466515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:04 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:05.638947 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e2e225c-1ec2-4b8d-88d1-7c6ed08e4136 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:05.649215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e2e225c-1ec2-4b8d-88d1-7c6ed08e4136 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1222 microversion: 2.1 time: 0.272056 Jun 07 13:12:05.658309 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 8/18] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:05 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:06.013278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-777861568", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:06.198423 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] validate_networks() for [('a9e5d769-a2db-434e-aa7d-110535a28faa', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:12:06.493632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:06.494255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:06.512742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:06.520152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:06.523885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:06.531583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:07.279205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:07.297488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d70e2cac-521f-4af3-ac5c-64d84df3b521 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.819440 Jun 07 13:12:07.300099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:06 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:07.584507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-29be72b3-fef7-43e3-8cea-73c3768816b1 req-fea51bbd-68dd-48fd-91e2-3ac8087dcca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5202ded4-7dfd-4c8c-880d-5a3bf04a494d", "tag": "9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:07.603154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-29be72b3-fef7-43e3-8cea-73c3768816b1 req-fea51bbd-68dd-48fd-91e2-3ac8087dcca7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:07.611939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-29be72b3-fef7-43e3-8cea-73c3768816b1 req-fea51bbd-68dd-48fd-91e2-3ac8087dcca7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:07.633393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-29be72b3-fef7-43e3-8cea-73c3768816b1 req-fea51bbd-68dd-48fd-91e2-3ac8087dcca7 service nova] Creating event network-changed:9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3 for instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d on hv-cinder-84496 Jun 07 13:12:07.634297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-29be72b3-fef7-43e3-8cea-73c3768816b1 req-fea51bbd-68dd-48fd-91e2-3ac8087dcca7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:12:07.635766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:07.636670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:07.637697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:07.638331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:07.651045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.compute.rpcapi [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:12:07.652181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] Releasing lock "compute-rpcapi-router" {{(pid=117832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:12:07.717873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-360a0b40-7a4e-4a8c-8a68-21920520539a None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.416439 Jun 07 13:12:07.718492 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 10/20] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:08.075890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:12:08.077185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:12:08.077804 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:12:08.078469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:12:08.079024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:12:08.097476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:08.097928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:08.098936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:08.099379 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:08.163669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:08.168224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for user 025ca1d10d5e49e984c7fd4e0b425f08 and project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:08.185568 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:12:08.188042 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:12:08.293390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8c75abd8-da10-4cbe-89db-27bfd9489016 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.318981 Jun 07 13:12:08.294095 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 11/21] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:12:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:12:08.305769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-990b8a62-988b-48a6-8871-c5ff185cf699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:08.306467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-990b8a62-988b-48a6-8871-c5ff185cf699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:08.317783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:08.318571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:08.328263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:08.328919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:08.330122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:08.331246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:08.424636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-990b8a62-988b-48a6-8871-c5ff185cf699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:08.432374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-990b8a62-988b-48a6-8871-c5ff185cf699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1221 microversion: 2.1 time: 0.131318 Jun 07 13:12:08.448882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:08 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:08.847015 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:08.855197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d64e9d7c-b827-4a6e-b344-03e46afa132e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.543626 Jun 07 13:12:08.865460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:08 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:09.387459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1256328162", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11e6938c-b8f3-4ebe-9f3a-91e0b1c73c1c"}], "security_groups": [{"name": "tempest-securitygroup--1953809909"}], "key_name": "tempest-keypair-376221652", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:09.454361 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:09.455711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:09.474038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:09.475011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:09.478216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:09.479629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:09.659913 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] validate_networks() for [('11e6938c-b8f3-4ebe-9f3a-91e0b1c73c1c', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:12:09.745518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:09.769697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ea92506-2589-42b7-a783-980905413493 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1225 microversion: 2.1 time: 0.320258 Jun 07 13:12:09.792530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:09 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1225 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:09.874431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:09.878875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:09.893667 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:09.897770 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:09.899974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:09.901543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:10.929563 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:10.940526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f93119b-4e60-44b9-b7c0-f5abd1ba2905 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 1.071989 Jun 07 13:12:10.961367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:09 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:10.974671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:10.975293 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:11.004877 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:11.008242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:11.025121 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:11.028105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:11.279751 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:11.298463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8194a6a6-30bd-4672-93ee-663739158246 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.330371 Jun 07 13:12:11.303645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:10 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:11.966232 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:11.967917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:11.982824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:11.983534 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:11.984558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:11.988100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:12.123366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:12:12.123960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:12:12.127289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:12:12.127769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:12:12.128257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:12:12.143935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:12.144397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:12.145250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:12.151124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:12.196301 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for project 6c6b89da4e96480ba68652cff770b388. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:12.203018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for user 8b341180925b454094d9bf5e6f5b3eaf and project 6c6b89da4e96480ba68652cff770b388. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:12.235845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:12:12.263144 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:12:12.270682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:12.288589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-881a8ac2-11ad-4713-9d6b-25e0f1c867ec tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.324083 Jun 07 13:12:12.289743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 16/27] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:11 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:12.319754 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:12.321758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:12.333851 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:12.335113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:12.336150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:12.336849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:12.427767 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dc12536a-7625-47ff-9ac7-d4eb11d47dcf tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.046619 Jun 07 13:12:12.436867 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 12/28] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jun 7 13:12:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:12:12.445825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1662629619", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f4d412-adf4-49aa-8722-e058a81a2829"}], "security_groups": [{"name": "tempest-securitygroup--1075299125"}], "key_name": "tempest-keypair-1417849956", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:12.477765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:12.511803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-51f27888-af30-4c28-bde4-b6aee322d73d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.195784 Jun 07 13:12:12.515121 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 17/29] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:12 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:12.527800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:12.528814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:12.642602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:12.658489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:12.658965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] validate_networks() for [('b4f4d412-adf4-49aa-8722-e058a81a2829', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:12:12.660075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:12.662043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-33d36e89-008b-4fe3-9e25-e8767431dbe9 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1281 microversion: 2.20 time: 0.145205 Jun 07 13:12:12.663075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 18/30] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:12 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:13.305773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:13.307747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:13.316861 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.320777 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.321739 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:12:13.322244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.322244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.322931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:12:13.323578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:12:13.324126 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:12:13.324690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:12:13.337720 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.338360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.339359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.339975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.360205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:13.364647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for user e1e6349a50ec4554b27b94b3f0f2dcbd and project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:13.378521 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:12:13.380968 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:12:13.444827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6494b9bf-4166-4abe-b3b3-89963dc51513 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.006476 Jun 07 13:12:13.450370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 13/31] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:12:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:12:13.460296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-363f498c-bebf-4a6b-b607-4592a6f69e81 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:13.462632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-363f498c-bebf-4a6b-b607-4592a6f69e81 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:13.561944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-363f498c-bebf-4a6b-b607-4592a6f69e81 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.579050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-363f498c-bebf-4a6b-b607-4592a6f69e81 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1238 microversion: 2.1 time: 0.119259 Jun 07 13:12:13.589878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 14/32] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:13 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:13.607676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:13.609132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:13.618009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.618624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.620098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.620995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.710953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.744626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2f981945-d48e-4b7a-aa1a-97f2cff9f047 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.132794 Jun 07 13:12:13.749636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:13 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:13.755048 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:13.755830 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:13.763008 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.764167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.765720 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:13.766391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:13.857857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.866267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.874577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b16348c8-5825-4d43-a533-93ac153f70ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.572730 Jun 07 13:12:13.884205 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 19/34] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:13 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:13.889339 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.892043 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:13.893506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-80c2c1d4-b4a9-45f4-bfac-7816f85e7283 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.145940 Jun 07 13:12:13.894621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 16/35] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:14.599003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:14.599726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:14.606113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.606637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.607498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.608003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.672252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:14.680607 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ce61dc1-63a0-448b-96b4-aa452e25dbea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.085399 Jun 07 13:12:14.681963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 20/36] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:14 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:14.762337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:14.763508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:14.770157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.770583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.771361 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.771797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.846217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:14.854503 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20cd1a3a-9b39-4143-9862-d4add5000903 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.095960 Jun 07 13:12:14.855592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:14 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:14.891864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:14.892525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:14.898506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.898955 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.899711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.900153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.912645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:14.913287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:14.915320 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:14.921503 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.923372 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.924302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:14.924884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:14.989476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:14.997833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:14.999280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:15.000506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0ef7f72f-98ae-4001-9a9e-1188de7c08ac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.092160 Jun 07 13:12:15.001065 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 18/38] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:14 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:15.035621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:15.043406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1c7d3ff9-90e0-4d45-a00c-40798884217e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.155569 Jun 07 13:12:15.043979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:14 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:15.702730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:15.703746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:15.714347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:15.715091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:15.716364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:15.717085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:15.779363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:15.787022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c77f7ecd-e788-4575-afa2-6bd209bdce73 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.090872 Jun 07 13:12:15.787601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:15 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:15.872454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:15.873333 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:15.879836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:15.880280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:15.881085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:15.881495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:15.943714 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:15.951355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-61e60474-16e4-4434-a4e2-b076749e53c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.082830 Jun 07 13:12:15.951904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:15 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:16.019182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:16.019740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:16.026055 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.026506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.027277 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.027719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.060675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:16.061328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:16.069805 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.070255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.071048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.071488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.155464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:16.165949 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:16.167921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:16.169340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-805cfd57-2cf8-4816-9e02-e2494f6066e8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.154204 Jun 07 13:12:16.170010 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:16 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:16.327968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:16.339385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e35200da-7e65-410b-a274-211947ae0038 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.282464 Jun 07 13:12:16.339984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:16 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:16.804836 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:16.806497 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:16.814574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.815030 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.815821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.816259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.879264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:16.888518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-77ae3bda-69f6-44f2-b577-60a4d02f0165 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.087692 Jun 07 13:12:16.889430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:16 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:16.968352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:16.969388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:16.975839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.976369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:16.977068 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:16.977517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.050347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:17.054240 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:17.059142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-49219b4b-f57b-4775-b376-0d1ab6c75ceb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.094598 Jun 07 13:12:17.065483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:16 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:17.195599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:17.196213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:17.203157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.203610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.204406 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.204835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.269157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:17.277660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:17.279186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:17.280330 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57d3dd80-d194-457e-8971-8047c59b5152 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.089871 Jun 07 13:12:17.280892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:17 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:17.357044 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:17.357686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:17.364695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.365151 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.365909 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.366342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.533922 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:17.543993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-94f83eb8-f9a0-415f-8bbd-6425177f7c1f tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.190675 Jun 07 13:12:17.545005 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 25/47] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:17 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:17.907410 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:17.908014 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:17.916391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.916832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:17.917696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:17.921479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.020687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.037365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e704cc7-c92c-4670-94b9-92aa822fad1e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.133797 Jun 07 13:12:18.037924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:17 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:18.080268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:18.081518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:18.084645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:18.099778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.100772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.102241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.103009 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.151300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:18.190042 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.199931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-833fa1f6-d887-46e7-adf1-e9af1d4d8842 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.127756 Jun 07 13:12:18.200523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:18 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:18.298433 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:18.299049 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:18.305462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.305891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.312351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.313160 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.464400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.475427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.479730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.483359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e083152-7608-445d-9807-0127100115b4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.188448 Jun 07 13:12:18.484323 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 24/50] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:18 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:18.560387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:18.561298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:18.570388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.571174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.572227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:18.572798 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:18.862947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:18.872539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d7a7927e-e425-46ab-8505-45d7911c9c09 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.316014 Jun 07 13:12:18.874692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 27/51] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:18 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:19.061314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:19.061798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:19.072135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.072575 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.078211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.195880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:19.218593 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:19.219957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:19.221100 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2c7077ca-eba9-4570-8a31-5a1bb69d1fc9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.170113 Jun 07 13:12:19.222394 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 25/52] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:19 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:19.229383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.229969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.230832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.231371 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.314409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:19.323175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c3ef97be-be2b-4336-92b3-c7f33b6dcbba tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.109385 Jun 07 13:12:19.324254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:19 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:19.503119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:19.503733 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:19.510226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.510674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.511449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.511922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.573246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:19.581915 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:19.583422 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:19.584703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d457fbd-b7b2-4a13-9091-353a2ed56818 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.086026 Jun 07 13:12:19.585408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 26/54] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:19 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:19.890567 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:19.891488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:19.897971 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.898425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:19.899191 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:19.899621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.098083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.107875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3518d8fa-42a8-4201-b708-d28a9d3014e8 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.221337 Jun 07 13:12:20.114182 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 29/55] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:19 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:20.243609 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.244944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:20.270300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.272551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.275345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.277400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.340029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.340650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:20.350199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.350984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.352088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.355987 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:20.357552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.358062 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.364532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eae30499-54c5-470d-992a-50ed15c0d28b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.128996 Jun 07 13:12:20.367721 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:20.474462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.485786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-708347f7-84b2-4689-9d10-f6fdf525ccaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.149398 Jun 07 13:12:20.486491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 30/57] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:20.610453 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:20.612014 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:20.618620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.619168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.619942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:20.620373 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:20.694518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.704356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.706651 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:20.708650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-924dcaa1-4168-45e9-9f39-4e2a575609dd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.107524 Jun 07 13:12:20.710222 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 28/58] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:20 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:21.131953 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:21.132570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:21.139248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.139694 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.140682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.141183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.299015 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.306634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9c800407-c636-4eac-ae4b-fa8712d026c0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.178654 Jun 07 13:12:21.307760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:21 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:21.383841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:21.384986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:21.392017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.392468 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.393260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.393688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.459992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.471003 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-04513839-47f1-4697-bed1-b19cfb6d7aa5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.089971 Jun 07 13:12:21.480873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:21 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:21.504602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:21.505384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:21.512033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.512678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.514457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.515047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.581224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.591743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a14a198-f592-428c-bb79-965d2146732f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.092543 Jun 07 13:12:21.592699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 32/61] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:21 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:21.729279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:21.730148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:21.741180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.757785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.759061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:21.761938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:21.843911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.854299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.856546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:21.858671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f090711-5d81-40ad-aa26-ce1b173a0bd4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.133961 Jun 07 13:12:21.858671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 30/62] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:21 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:22.323762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:22.324892 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:22.332874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.333707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.334708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.335463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.495930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:22.507629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:22.528630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.529163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.536424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.545991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.648899 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:22.652858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=24 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:22.662800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e97890ae-6bf3-4b43-96c5-9f2d008b26bb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.342932 Jun 07 13:12:22.663385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:22 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:22.667990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:22.668746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:22.678627 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.679411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.680371 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.681524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.780031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:22.791047 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0bfd2d72-a14b-4a56-b07d-85ded2b7b157 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.306113 Jun 07 13:12:22.793173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 31/64] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:22 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:22.795955 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:22.804266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-590e4b42-8a65-41f6-beed-88ba2589781d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.139390 Jun 07 13:12:22.805428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:22 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:22.877359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:22.878851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:22.892685 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.893710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:22.894254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:22.896864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.009507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:23.020113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:23.021807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:23.023158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-05aeaf86-3048-47c1-80a5-fb2b8f31daef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.150287 Jun 07 13:12:23.034552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 32/66] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:22 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:23.680147 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:23.680854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:23.687736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.688267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.689243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.689759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.813854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:23.817299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:23.822384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.823562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=24 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:23.830672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.832025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.832842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.833829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.843117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:23.860721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d6161bc0-4cca-412d-98ed-40a98ebd0226 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.184007 Jun 07 13:12:23.862767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:23 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:23.871030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:23.872318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:23.886057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.887155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.888779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:23.890460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:23.953997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:23.961641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-05fd4161-5773-4b9e-a358-738c6c46945d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.154713 Jun 07 13:12:23.962240 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 33/68] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:23 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:23.996146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:24.004482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4fdea19a-6d79-4b42-bb29-d184c43883c2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1273 microversion: 2.1 time: 0.140005 Jun 07 13:12:24.005172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 36/69] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:23 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:24.042241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:24.043141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:24.051533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:24.051992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:24.052775 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:24.053247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:24.133377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:24.143328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:24.145578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:24.147240 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-735f665b-01c6-4e17-b096-b4cf11c62b5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1285 microversion: 2.20 time: 0.109006 Jun 07 13:12:24.147827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 34/70] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:24 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:24.882207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:24.883512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:24.894060 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:24.894591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:24.895451 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:24.895963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:24.980281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:24.981499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:25.008501 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.008983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.011780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.012230 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.129051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.139705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d2df867-cea2-4610-a18f-237e32f396f4 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.265222 Jun 07 13:12:25.149795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:24 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:25.160897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:25.161581 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:25.168018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.168465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.169579 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.170018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.270941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.282562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.284590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-99b07e6f-61be-4643-b64c-9c9de437f544 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1291 microversion: 2.1 time: 0.132397 Jun 07 13:12:25.285456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:25 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1291 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:25.293197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c9687cd8-ac13-4ca4-b1d6-dc900e42f6d6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1242 microversion: 2.1 time: 0.317131 Jun 07 13:12:25.296877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 35/73] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:24 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1242 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:25.299604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:25.301934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:25.316467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.319389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.320305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:25.320854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:25.415662 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.428774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.434589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:25.437441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2efb360-edf8-47df-a02e-3dfe2ee6765e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1333 microversion: 2.20 time: 0.150319 Jun 07 13:12:25.441932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 39/74] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:25 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:26.157260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:26.158412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:26.164774 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.165252 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.166085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.166579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.302105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:26.302690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:26.309469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.309910 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.310668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.311092 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.372797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.381961 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6e609d8-c357-4f63-a48f-0f9bfa33a533 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1279 microversion: 2.1 time: 0.083637 Jun 07 13:12:26.382750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 40/75] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:26 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:26.387399 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:26.388226 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:26.395604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.396196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.397235 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.397822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.418048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:26.466992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.476202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-71886357-a85a-491c-99d4-b4476128275f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.092220 Jun 07 13:12:26.476800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 41/76] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:26 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:26.481415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:26.482016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:26.488225 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.488701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.489522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:26.489950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:26.505479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.515437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f5b01aa6-5c21-435f-b0b9-01cd5cc3ff6b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.361990 Jun 07 13:12:26.516359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 36/77] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:26 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:26.565333 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.574375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.575897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:26.577001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-404b4b11-9b73-456c-b932-eb4804b81510 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.099198 Jun 07 13:12:26.577585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 42/78] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:26 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:27.288991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f6f74feb-3ff6-444f-8e7e-6ef5698b9915 req-8c761179-51ca-437d-ab50-d37637cf9237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf", "tag": "95c54d86-0d75-40fc-8e67-f43d4eef6799"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:27.302327 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6f74feb-3ff6-444f-8e7e-6ef5698b9915 req-8c761179-51ca-437d-ab50-d37637cf9237 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.302788 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f6f74feb-3ff6-444f-8e7e-6ef5698b9915 req-8c761179-51ca-437d-ab50-d37637cf9237 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.330700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f6f74feb-3ff6-444f-8e7e-6ef5698b9915 req-8c761179-51ca-437d-ab50-d37637cf9237 service nova] Creating event network-changed:95c54d86-0d75-40fc-8e67-f43d4eef6799 for instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf on hv-cinder-84496 Jun 07 13:12:27.339965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f6f74feb-3ff6-444f-8e7e-6ef5698b9915 req-8c761179-51ca-437d-ab50-d37637cf9237 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055215 Jun 07 13:12:27.342143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 37/79] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:27.398726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:27.399321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:27.405886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.406403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.407186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.407624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.493802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:27.494501 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:27.500905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.501390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.502532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.502962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.544124 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.552876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6d73655d-f2cd-4524-b478-18e74c15e013 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.158043 Jun 07 13:12:27.553576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 43/80] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:27 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:27.558091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:27.559070 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:27.565636 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.566024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.566781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.567375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.578416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.586183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0b52b1e5-2647-4917-b4a0-5c3298f276f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.096586 Jun 07 13:12:27.586766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 38/81] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:27 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:27.594603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:27.595401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:27.601600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.602046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.602806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:27.603229 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:27.664872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.674457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.675948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.677085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11a7ea4b-f0ff-4de7-a97d-dca39a31e10f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.086326 Jun 07 13:12:27.677894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 39/82] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:27 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:27.701904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:27.711928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d12a8bf0-82de-4c70-afdd-24225d758274 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.155687 Jun 07 13:12:27.711928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 44/83] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:27 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:27.757992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2103505424", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "networks": [{"uuid": "55fc1070-3007-41c4-b494-234a45a2d448"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:27.808260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] validate_networks() for [('55fc1070-3007-41c4-b494-234a45a2d448', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:12:28.158845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:12:28.159406 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:12:28.159718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:12:28.160123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:12:28.160529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:12:28.170703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.171197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.172314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.172781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.191421 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Getting quotas for project 56eca409cb874456afc7f0acc51c7e40. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:12:28.195478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Getting quotas for user aaefc46a7e6d431c9eebc5233389c61e and project 56eca409cb874456afc7f0acc51c7e40. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:12:28.206710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:12:28.211276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:12:28.256413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e82b97c6-f616-4d64-bf57-13ee115d87f5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502258 Jun 07 13:12:28.265762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 40/84] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:12:28.271499 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afaa90b9-4bab-462c-9611-7e91b50c53db tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:28.272111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-afaa90b9-4bab-462c-9611-7e91b50c53db tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:28.363823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-afaa90b9-4bab-462c-9611-7e91b50c53db tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.371495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afaa90b9-4bab-462c-9611-7e91b50c53db tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1214 microversion: 2.1 time: 0.103773 Jun 07 13:12:28.372075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 45/85] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:28 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:28.570814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:28.572737 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:28.581355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.582157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.583921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.586103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.604642 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:28.606114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:28.618687 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.619335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.620318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.620948 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.705369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.715326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b33b1e6b-1bea-47fc-815d-7287b7bd4e0c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.115180 Jun 07 13:12:28.715907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 46/86] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:28 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:28.732896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:28.733777 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:28.741447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.741939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.742810 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.743332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.767738 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.775787 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-945087a5-bb45-4c0d-ab44-17d821fb0206 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.209801 Jun 07 13:12:28.776624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 41/87] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:28 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:28.790798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:28.792159 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:28.799058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.799593 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.800446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:28.800942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:28.827074 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.836193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.838027 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.839178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f5f73d1e-b2e9-4442-a2d9-40143fc991a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.122208 Jun 07 13:12:28.839738 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 47/88] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:28 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:28.945519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:28.953174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f378c4a-0b7c-485d-b6f5-72ff8edca6b0 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.166300 Jun 07 13:12:28.954116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 42/89] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:28 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:29.394202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:29.395199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:29.405570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.406267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.407037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.407473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.469244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.477133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d58e127c-21eb-4a4c-ad0b-a958b36e7048 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1218 microversion: 2.1 time: 0.089737 Jun 07 13:12:29.477674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 48/90] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:29 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:29.732788 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:29.733343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:29.739922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.740367 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.741169 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.741598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.796300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:29.797270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:29.803753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.804201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.805111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.805620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.812476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.820383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-582104f5-ea56-46f2-843e-feec2984a1e9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.091910 Jun 07 13:12:29.821164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 43/91] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:29 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:29.861503 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:29.862111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:29.868413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.868858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.869652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.870080 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.932147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.939593 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.940206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.941734 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:29.942838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-44d5aa2a-ea33-4811-833c-fdb41268093e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.085676 Jun 07 13:12:29.943439 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 44/92] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:29 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:29.947211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-69117b32-1a81-4e54-9e4f-27a4ae9d2743 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.156949 Jun 07 13:12:29.947769 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 49/93] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:29 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:29.969035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:29.969771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:29.975944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.976385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:29.977183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:29.977614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.286508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:30.291806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:30.298401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d528923-39a8-436e-a5cf-9ddaff34332d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.333188 Jun 07 13:12:30.298975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 45/94] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:29 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:30.495155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:30.495771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:30.502629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.503067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.503823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.504247 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.563978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:30.571565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-59d242d1-ac07-4084-852c-971bc09fbe08 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1218 microversion: 2.1 time: 0.081053 Jun 07 13:12:30.572178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 50/95] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:30 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:30.842172 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:30.843183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:30.850346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.850819 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.851588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.852073 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.920617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:30.928481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e35d27fa-5d06-48e1-9f58-954977023f50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.093001 Jun 07 13:12:30.929338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 46/96] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:30 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:30.965111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:30.966061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:30.967119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:30.968079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:30.975647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.976341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.977574 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.978002 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.978216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.978691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:30.979848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:30.980918 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.042703 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.051553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.053056 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.054225 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25978b2d-7d2a-44f8-a0a3-fd9e3e4b62c1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.095865 Jun 07 13:12:31.054787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 51/97] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:30 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:31.110803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.121626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8feaf127-200f-4c6d-9935-f7b8c3743187 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.159806 Jun 07 13:12:31.122480 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 47/98] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:30 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:31.316395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:31.317000 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:31.323693 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.324134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.324890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.325357 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.473207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.481159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-10c3d543-593f-4824-a3ab-ceb4319bc045 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.168637 Jun 07 13:12:31.481728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 52/99] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:31 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:31.592263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:31.593677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:31.600215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.601153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.601920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.602358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.672948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:31.681164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aa166221-eed2-4f06-8a06-540e3a01876f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1218 microversion: 2.1 time: 0.095422 Jun 07 13:12:31.681731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:31 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:31.949647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:31.950585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:31.957953 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.958393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:31.959149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:31.959623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.023577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.031160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fd4e1912-9beb-4114-9659-988c1e0e16e7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.088290 Jun 07 13:12:32.031836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 53/101] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:31 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:32.071866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:32.072417 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:32.081197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.081636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.082400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.082834 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.139483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:32.140099 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:32.145194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.146597 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.147077 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.147923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.148351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.154178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.155709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.156962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a31c1818-5096-4271-b28c-2e7a45b7ce3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.089087 Jun 07 13:12:32.157784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 49/102] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:32 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:32.282784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.293658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c39bb4ab-91f5-4982-aefe-5f71e7c6542f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.157850 Jun 07 13:12:32.294415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 54/103] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:32 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:32.498766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:32.499290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:32.506418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.506936 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.508316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.508754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.637495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.645142 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a6655d6c-c92c-4a40-a851-8690426124ba tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.150329 Jun 07 13:12:32.645711 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 50/104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:32 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:32.700878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:32.701514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:32.708166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.708644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.709460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:32.709873 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:32.782637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:32.790367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a55a030-071e-422a-a5d4-b57e1f311a5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1218 microversion: 2.1 time: 0.093455 Jun 07 13:12:32.790943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:32 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:33.052722 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:33.053312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:33.059824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.060272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.061179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.061638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.131548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:33.141922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11ad6420-e05d-4f60-8b1a-16f9aed51ba6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1290 microversion: 2.1 time: 0.092962 Jun 07 13:12:33.142344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 51/106] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:33 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:33.175241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:33.175851 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:33.181970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.182418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.183184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.183620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.250648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:33.259448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:33.261154 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:33.262260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-74772bbc-3337-43d8-8968-137cbc422836 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1341 microversion: 2.20 time: 0.091660 Jun 07 13:12:33.262813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 56/107] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:33 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1341 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:33.312091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:33.312649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:33.319514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.319965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.320717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.321183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.467608 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:33.479968 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d69aa648-7fa6-4636-8240-f362e646ae6a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.171524 Jun 07 13:12:33.481294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:33 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:33.662312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:33.662923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:33.673978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.676313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.677388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.679046 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.807621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:33.808371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:33.824647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.827505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:33.829045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:33.830668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.005354 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.012199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.014477 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a2e5c584-e104-480b-860f-ea714220fbd5 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1210 microversion: 2.1 time: 0.211062 Jun 07 13:12:34.018004 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 53/109] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:33 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:34.034567 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2842b6ac-8a5b-496f-b006-8ac1668a1f68 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.376147 Jun 07 13:12:34.044912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:33 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:34.162398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:34.163646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:34.179071 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.179752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.180735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.181421 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.281422 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:34.282289 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:34.292904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.293386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.294174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.294611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.455545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.465969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.467739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.469366 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-913dcc42-b776-4262-9fba-b8523e637500 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1339 microversion: 2.20 time: 0.193167 Jun 07 13:12:34.481943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 58/111] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:34 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:34.499517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:34.500245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:34.520499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:34.541891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2d0eb24f-3d64-4933-98a8-57ced7f55dff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1296 microversion: 2.1 time: 0.383198 Jun 07 13:12:34.561571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.568764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 54/112] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:34 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1296 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:34.569570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.574403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:34.577832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:34.589752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:35.034858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:35.035708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:35.050853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.051918 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.052552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.053653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.055708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.058686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7dbbc753-25aa-4ba0-92bc-211273f87889 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.564443 Jun 07 13:12:35.069673 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:34 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:35.078326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:35.079176 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:35.086565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.087308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.088315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.088938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.633183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.648374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c1ac44c-5385-4f03-9c6e-762966ddf60a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1272 microversion: 2.1 time: 0.617698 Jun 07 13:12:35.650214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 55/114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:35 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1272 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:35.659279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:35.660360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:35.677288 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.678067 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.678991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.679567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.764033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.778379 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-126d1770-923d-4ba2-9f9b-0a79aa89d7ca tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.704678 Jun 07 13:12:35.780918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:35 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:35.795697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:35.796783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:35.803791 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.804510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.805781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:35.806585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:35.899033 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.930682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.938911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:35.950092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69148d13-43df-4c0c-ae06-e360844f6cac tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1339 microversion: 2.20 time: 0.290548 Jun 07 13:12:35.955266 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 56/116] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:35 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:36.076676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:36.080638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:36.081272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:36.087428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff521c56-a705-47aa-a719-49ed1c8baefe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1296 microversion: 2.1 time: 0.304198 Jun 07 13:12:36.088022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:35 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1296 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:36.101240 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.102016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.102858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.103747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.450488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-872e46d0-7ced-4cb2-9b3f-d4265095e482 req-93daad59-e978-4ddf-b5a1-5e1690c448be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cd04a7-3053-43a2-8e39-d59bb0687ee4", "tag": "f1126c3b-69b8-4c60-9364-0df57e08c60a"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:36.496283 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-872e46d0-7ced-4cb2-9b3f-d4265095e482 req-93daad59-e978-4ddf-b5a1-5e1690c448be service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.496590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-872e46d0-7ced-4cb2-9b3f-d4265095e482 req-93daad59-e978-4ddf-b5a1-5e1690c448be service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.545701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-872e46d0-7ced-4cb2-9b3f-d4265095e482 req-93daad59-e978-4ddf-b5a1-5e1690c448be service nova] Creating event network-changed:f1126c3b-69b8-4c60-9364-0df57e08c60a for instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 on hv-cinder-84496 Jun 07 13:12:36.547713 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-872e46d0-7ced-4cb2-9b3f-d4265095e482 req-93daad59-e978-4ddf-b5a1-5e1690c448be service nova] Acquired lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 13:12:36.551858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.552724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:36.552862 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.555119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.555552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.562426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d33b3e03-f171-4314-abdb-6fc44dd4a8c0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.488322 Jun 07 13:12:36.566652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:36 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:36.591781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.compute.rpcapi [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 13:12:36.593173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] Releasing lock "compute-rpcapi-router" {{(pid=117833) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 13:12:36.643774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f82cafd-19c9-4be0-8514-32860e305211 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211020 Jun 07 13:12:36.644390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 62/119] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:36.670063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:36.671359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:36.698364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.700972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.702661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.704861 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.808923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:36.809674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:36.821405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.821852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.822619 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.833792 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.853512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:36.864287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8ba4bf07-893e-4699-a072-2dfae5717b9a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1272 microversion: 2.1 time: 0.200003 Jun 07 13:12:36.865147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:36 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:36.974999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:36.975922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:36.984998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.986063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:36.987647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:36.988418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.192012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.200810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.202598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.204175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-afd589e2-b9f0-44a7-8f93-64e4214852bd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.235483 Jun 07 13:12:37.205442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 59/121] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:36 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:37.210247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:37.211060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:37.217673 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.218416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.219723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.220305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.248105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.256753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc56c82b-dec8-454f-8ea9-a2bafb998dc9 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.463545 Jun 07 13:12:37.257981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 63/122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:36 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:37.417434 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.428123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-39885934-da30-4798-8b46-2465c7f42e20 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.220379 Jun 07 13:12:37.428123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 60/123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:37 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:37.587355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:37.588031 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:37.594932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.595568 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.596881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.597414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.761571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:37.769290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e1143912-a198-4e49-a6ca-67177b45f8d4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.186662 Jun 07 13:12:37.769984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 64/124] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:37 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:37.882791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:37.883497 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:37.885566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:37.892177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.893199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:37.894205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:37.894856 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.036758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.044752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cd4a2760-4099-48e4-ac04-628f28b3d5c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.167250 Jun 07 13:12:38.045584 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 61/125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:37 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:38.222306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:38.223545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:38.229496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.229945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.230718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.231153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.274347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:38.285211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:38.288175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.289287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.294099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.294956 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.296924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.297760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.318509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.368585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:38.415323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.424045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.425921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.427205 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f6ad9f91-a1e8-4413-adf8-9a9033f8976e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.208954 Jun 07 13:12:38.428352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 65/126] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:38 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:38.443480 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:38.444373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:38.451221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.451913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.453051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.453701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.468187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.476959 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f1c5314e-968b-44ab-822a-6c2109ac2b1c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.206794 Jun 07 13:12:38.477758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 62/127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:38 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:38.609126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.618332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9c644e0c-4869-4f38-a1ff-f3d1eac5227f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.178571 Jun 07 13:12:38.619142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 66/128] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:38 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:38.787686 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:38.788455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:38.795952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.796524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.797342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:38.797773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:38.937723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:38.949317 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec2e72ba-1b03-4af5-9294-0f60a5d897a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.166363 Jun 07 13:12:38.950105 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 63/129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:38 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:39.063565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:39.064353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:39.071834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.072870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:39.073824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.074440 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:39.235335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:39.243289 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1309cd43-50e9-42ad-a82c-24a592c308df tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.186016 Jun 07 13:12:39.244115 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 67/130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:39 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:39.446670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:39.448508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:39.459102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.460563 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:39.461594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.462642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:39.495167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:39.495799 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:39.505561 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.506016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:39.506874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:39.507285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.202512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.210697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-323fe41a-92d0-43e9-8a24-e5a32809ed15 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.719471 Jun 07 13:12:40.220930 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 68/131] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:39 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:40.225814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:40.226606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:40.232663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.233436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.234885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.235471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.328996 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.352299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.356607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.358393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-553f166d-1c2e-4298-993a-4bfd5c297c47 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.916623 Jun 07 13:12:40.359601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 64/132] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:39 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:40.368932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:40.369718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:40.381187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.381940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.384132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.384692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.654745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.668815 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a9186c61-86bf-4548-939b-052ff6e35d37 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.307660 Jun 07 13:12:40.672029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:40 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:40.684599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:40.686598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:40.700744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.703556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.705310 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:40.707356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:40.925880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:40.957937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9728dc65-01d8-4225-a472-5a277c94c27b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.735726 Jun 07 13:12:40.971735 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 69/134] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:40 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:41.114407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:41.129523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e6ba6118-ecf8-4629-90e4-425d132b5110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.453669 Jun 07 13:12:41.131053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 66/135] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:40 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:41.228290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:41.228903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:41.251736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.256165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.260599 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.262603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.327679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8f2b2fef-109e-4465-9583-e6b4f2327b9c req-8ded8695-ccd8-457c-adc8-a9802978a29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:41.337227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8f2b2fef-109e-4465-9583-e6b4f2327b9c req-8ded8695-ccd8-457c-adc8-a9802978a29c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.337748 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8f2b2fef-109e-4465-9583-e6b4f2327b9c req-8ded8695-ccd8-457c-adc8-a9802978a29c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.350952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8f2b2fef-109e-4465-9583-e6b4f2327b9c req-8ded8695-ccd8-457c-adc8-a9802978a29c service nova] Creating event network-changed:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:12:41.356783 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8f2b2fef-109e-4465-9583-e6b4f2327b9c req-8ded8695-ccd8-457c-adc8-a9802978a29c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033331 Jun 07 13:12:41.358317 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 67/136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:41.381079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:41.382498 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:41.395706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.396158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.396967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.397412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.613358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:41.624134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:41.634415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:41.639633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bf097661-2552-4f59-b6cf-6a6f29797f0b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.411806 Jun 07 13:12:41.640146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:41.641562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:41 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:41.645981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1dd17e2a-0ea3-41d2-8291-7a7af063cadb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.269407 Jun 07 13:12:41.649640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 68/138] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:41 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:41.688584 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:41.689317 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:41.696314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.696858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.698061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:41.698683 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:41.979214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:41.989495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:41.999652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.000099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.002808 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.003247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.095149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:42.106262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e5c97b87-c3a4-42cc-8b21-37ea17f6fc0b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.422024 Jun 07 13:12:42.107311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:41 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:42.264499 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-869ed4f4-38e9-4564-a207-46c4a92dcaaf req-8946a999-7cd8-4fc8-ace8-2a597cf139f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5202ff0-c8c1-4c4f-a89c-f536f724298f", "tag": "749be2dc-b22c-4710-8386-8d454b1b5992"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:42.280635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-869ed4f4-38e9-4564-a207-46c4a92dcaaf req-8946a999-7cd8-4fc8-ace8-2a597cf139f6 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.281937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-869ed4f4-38e9-4564-a207-46c4a92dcaaf req-8946a999-7cd8-4fc8-ace8-2a597cf139f6 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.303721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-869ed4f4-38e9-4564-a207-46c4a92dcaaf req-8946a999-7cd8-4fc8-ace8-2a597cf139f6 service nova] Creating event network-changed:749be2dc-b22c-4710-8386-8d454b1b5992 for instance d5202ff0-c8c1-4c4f-a89c-f536f724298f on hv-cinder-84496 Jun 07 13:12:42.311068 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-869ed4f4-38e9-4564-a207-46c4a92dcaaf req-8946a999-7cd8-4fc8-ace8-2a597cf139f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191068 Jun 07 13:12:42.312365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 72/140] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:42.322561 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:42.324394 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:42.334086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.336855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.338490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.339132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.366515 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:42.378801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-374bf469-f098-4a20-84f4-51423c6c28f1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.405715 Jun 07 13:12:42.380045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 69/141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:41 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:42.661570 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:42.664078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:42.681589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.682091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.683543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.684017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.865719 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:42.877535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a8cfd7c8-5601-4563-b636-7d93ad75039d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.562798 Jun 07 13:12:42.878441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 73/142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:42 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:42.883736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:42.884332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:42.892874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.893425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:42.894428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:42.895119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.073766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.083766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-30db4b6d-21f7-4dd8-8fc7-c167d2e670df tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.429769 Jun 07 13:12:43.093755 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 70/143] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:42 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:43.131571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.139557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.141273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.142689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bcf02539-56cc-4d5b-a0e1-39037630ec13 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.263033 Jun 07 13:12:43.143385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 74/144] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:42 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:43.148649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:43.149521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:43.152860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:43.156814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.157278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.158083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.158512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.177959 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-23ccded1-0ed3-4d4a-ae4c-d8106bdff20e req-d073e4ad-50d5-4475-83f7-db14028f2c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202ded4-7dfd-4c8c-880d-5a3bf04a494d", "name": "network-vif-plugged", "status": "completed", "tag": "9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:43.189400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-23ccded1-0ed3-4d4a-ae4c-d8106bdff20e req-d073e4ad-50d5-4475-83f7-db14028f2c66 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.190220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-23ccded1-0ed3-4d4a-ae4c-d8106bdff20e req-d073e4ad-50d5-4475-83f7-db14028f2c66 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.206820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-23ccded1-0ed3-4d4a-ae4c-d8106bdff20e req-d073e4ad-50d5-4475-83f7-db14028f2c66 service nova] Creating event network-vif-plugged:9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3 for instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d on hv-cinder-84496 Jun 07 13:12:43.213657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-23ccded1-0ed3-4d4a-ae4c-d8106bdff20e req-d073e4ad-50d5-4475-83f7-db14028f2c66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117251 Jun 07 13:12:43.214601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 71/145] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:43.309185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.317786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-367ddcdf-36a4-496e-8fe5-10e00abe42dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.173235 Jun 07 13:12:43.318360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 75/146] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:43 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:43.396559 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:43.397435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:43.404121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.404567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.405441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.406243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.539871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:43.547764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9d416313-3436-4d84-bf91-3a21e0f2202d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.155357 Jun 07 13:12:43.548336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 72/147] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:43 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:43.895376 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:43.895979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:43.902149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.902582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:43.903319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:43.903942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.034449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.037854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:44.042442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-99fb92db-a8ee-4e95-a614-b44c818d9263 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.151072 Jun 07 13:12:44.043003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 76/148] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:43 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:44.100709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:44.101354 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:44.107573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.108009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.108963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.109259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.161451 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:44.162119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:44.171918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.172549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.173582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.174527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.280093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.292726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a575d4bf-2e63-47a0-b75e-19e05c08af82 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.195759 Jun 07 13:12:44.293727 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 73/149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:44 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:44.330908 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cd268fac-3e6c-415b-8da7-397720c154e4 req-2bc6cdbc-4e41-4e66-8c8d-17deb3b1bb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e776100-542e-451a-b985-daa5c5341bfd", "tag": "2a4245a9-b510-4749-8d5c-bbc49e30e457"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:44.340591 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cd268fac-3e6c-415b-8da7-397720c154e4 req-2bc6cdbc-4e41-4e66-8c8d-17deb3b1bb17 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.341046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cd268fac-3e6c-415b-8da7-397720c154e4 req-2bc6cdbc-4e41-4e66-8c8d-17deb3b1bb17 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.348779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.357265 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.358997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.359945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cd268fac-3e6c-415b-8da7-397720c154e4 req-2bc6cdbc-4e41-4e66-8c8d-17deb3b1bb17 service nova] Creating event network-changed:2a4245a9-b510-4749-8d5c-bbc49e30e457 for instance 3e776100-542e-451a-b985-daa5c5341bfd on hv-cinder-84496 Jun 07 13:12:44.360331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6af3dab-bdbf-4caa-848a-b35c330691ed tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.202801 Jun 07 13:12:44.360966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 77/150] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:44 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:44.365500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:44.366091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:44.372364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cd268fac-3e6c-415b-8da7-397720c154e4 req-2bc6cdbc-4e41-4e66-8c8d-17deb3b1bb17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046186 Jun 07 13:12:44.373189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 74/151] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:12:44.373311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.373577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.374437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.374864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.509787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.517528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-96fa3bc0-a8f4-4c38-8b37-f74724bab58b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.155428 Jun 07 13:12:44.518140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 78/152] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:44 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:44.565438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:44.566126 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:44.572586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.573038 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.573829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:44.574264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:44.714596 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:44.722488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88ea2f6f-b606-4045-86ac-05f38050457c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.161361 Jun 07 13:12:44.723092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 75/153] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:44 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:45.063078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:45.063746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:45.070898 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.071386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.072219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.072699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.213325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.221796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d772e642-ab64-4b68-84c8-cb43fb8cbba7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.165057 Jun 07 13:12:45.222352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:45 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:45.312493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:45.313735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:45.323414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.324080 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.325289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.325937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.379270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:45.379867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:45.386325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.386756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.387513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.387936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.475428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.483220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-668c89f2-48d3-4f14-9dff-f84b56227afd tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.176688 Jun 07 13:12:45.483917 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 76/155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:45 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:45.530767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.533907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:45.534518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:45.539022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.540435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.540571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.540869 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.541641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8ed78c0e-7d18-46ff-9ff9-9a34a9e42b05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.166710 Jun 07 13:12:45.541745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.542070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.542248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 80/156] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:45 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:45.681760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.691527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17745db2-acb2-483c-bbef-d234e4808164 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.161620 Jun 07 13:12:45.692217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 77/157] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:45 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:45.740055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:45.740587 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:45.746821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.747293 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.748033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:45.748470 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:45.894734 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:45.902583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2e146b3-8477-4293-a893-d6fe0626d57e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.166552 Jun 07 13:12:45.903407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:45 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:46.241922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:46.242756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:46.252194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.252831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.253879 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.254690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.398034 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:46.405823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b07c762c-e28f-4e68-bf61-594bd25c4c62 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.169729 Jun 07 13:12:46.406404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:46 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:46.500169 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:46.500776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:46.507898 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.508342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.509127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.509560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.559864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:46.560611 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:46.567482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.567933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.568707 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.569179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.585721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:46.649595 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:46.657633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ddbe1ff4-ddaa-4aa8-bd93-e97a0b32fdc5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.161584 Jun 07 13:12:46.658402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 82/160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:46 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:46.696850 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:46.706195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:46.707829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:46.708943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dbd8c1ce-9ed4-40d9-be65-8b2f9bafd92b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.153023 Jun 07 13:12:46.709331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:46.709475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 79/161] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:46 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:46.710144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:46.717410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.717853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.718706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.719135 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.920171 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:46.921336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:46.927257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.927695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.928456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:46.929558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:46.995749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.003688 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-23899e4c-cce0-4bb6-8edb-f652c4cd6809 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.298862 Jun 07 13:12:47.004256 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:46 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:47.060640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.072599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0e350770-1fc2-4f93-9e98-6b3a3c46b518 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.156497 Jun 07 13:12:47.073576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 80/163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:46 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:47.424365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:47.425064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:47.434912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.434912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.434912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.434912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.583526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.591159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bd028cf4-a81c-467e-8f1f-cfce2a85546e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.171628 Jun 07 13:12:47.591724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 84/164] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:47 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:47.676656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:47.677635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:47.686902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.687550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.688613 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.689273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.697604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:47.729238 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:47.730006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:47.738028 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.738515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.739455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:47.740634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:47.926565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.935762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8a8ec90d-6673-4e3f-97bf-995e646c99f5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.264882 Jun 07 13:12:47.941853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 81/165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:47 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:47.955776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.970876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.973305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:47.975140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7a54bf9b-5c88-487b-ab69-95a183182710 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.251589 Jun 07 13:12:47.987322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 85/166] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:47 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:48.021040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:48.021708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:48.036448 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.036906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.038137 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.038654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.090081 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:48.090693 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:48.097448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.097898 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.098670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.099105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.174876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:48.182620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d23c68df-e206-4e1b-af1b-b8cb5ddfd0a9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.166097 Jun 07 13:12:48.183195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:48 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:48.230912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:48.239316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c4e28dbd-4eed-4e35-8961-da5009ae0bee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.153090 Jun 07 13:12:48.239896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 86/168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:48 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:48.612661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:48.613283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:48.619773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.620291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.621481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.622105 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.762775 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:48.777948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b5ee1e1e-f70c-4d0c-a308-6b8d3e496b6a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.169379 Jun 07 13:12:48.778405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 83/169] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:48 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:48.957757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:48.958372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:48.964605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.965103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.965869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:48.966364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:48.994213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:48.994793 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:49.002238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.002692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.003463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.003898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.122595 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.137299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f0899594-3bb4-4452-b716-f08bfd750696 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.180550 Jun 07 13:12:49.137299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:48 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:49.152544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.161550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.163218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.164744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e9f559d5-5fff-4643-8efd-dcb92a7ec7f6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.174599 Jun 07 13:12:49.165561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 84/171] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:48 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:49.199889 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:49.200798 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:49.208059 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.208529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.209402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.209860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.256131 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:49.256884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:49.263165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.263757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.264596 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.265374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.343317 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.351384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3e68f72b-2cd9-4e04-b735-7604c9e2e536 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.155587 Jun 07 13:12:49.351927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:49 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:49.396198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.403819 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e09df636-8399-4df8-9a0e-4cfa53c5d62f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.151530 Jun 07 13:12:49.404387 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:49 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:49.797823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:49.798554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:49.806786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.807413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.808586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:49.809188 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:49.943881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:49.951677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41f025eb-a531-4661-803c-da23073149a9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.159724 Jun 07 13:12:49.952233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:49 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:50.153432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:50.154042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:50.161123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.162031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.162989 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.163423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.183873 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:50.184388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:50.196697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.197263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.198156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.198663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.326768 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.335077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f02164f-bfc3-49dc-a087-67bc83a89f65 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.185358 Jun 07 13:12:50.335698 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:50 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:50.368029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:50.368631 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:50.375084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.375513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.376646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.377091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.515356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.523618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2567ce82-a787-4150-92f7-132ea30f0d0a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.159621 Jun 07 13:12:50.524205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 87/176] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:50 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:50.532569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.534717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:50.535311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:50.540992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.542461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.542583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.543054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.543605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8fd111f9-9fd5-431d-9f20-d091adff5e99 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.364143 Jun 07 13:12:50.544114 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.544223 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 90/177] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:50 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:50.544732 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.683484 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:50.694561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2342596d-05ee-485d-a76a-d9b91059c0a1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.169091 Jun 07 13:12:50.695360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 88/178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:50 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:50.971634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:50.972319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:50.979979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.980504 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:50.981422 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:50.982266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.116865 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.125318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a027c3f4-321d-4cc3-99aa-8b74dff0eae1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.159353 Jun 07 13:12:51.125890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 91/179] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:50 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:51.351822 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:51.352263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:51.358907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.359198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.359964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.360398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.488765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.496224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f197e16-4b8d-47e9-8562-99616d67c93b tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.148406 Jun 07 13:12:51.496780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 89/180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:51 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:51.542509 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:51.543083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:51.550309 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.550781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.551544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.551972 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.562254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:51.563287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:51.573045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.574040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.574943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.575257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.689510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.697102 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bee7156c-6b65-4899-895e-f33d7200f491 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.158467 Jun 07 13:12:51.697680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 92/181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:51 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:51.711397 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:51.712116 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:51.718601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.719044 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.719813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:51.720242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:51.725442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.733437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.735343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.736511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c0c1cd1-069d-4898-808b-388baf225c94 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.178230 Jun 07 13:12:51.737070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 90/182] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:51 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:51.739743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:51.851364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:51.863109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3030fa8b-31e1-4899-ba91-1f721f29385d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.155058 Jun 07 13:12:51.863884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 93/183] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:51 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:52.147077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:52.148139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:52.158756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.159475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.160776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.161553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.297257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.305361 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20a2eb7c-635e-4f0e-8ffc-af19ba910c90 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.164683 Jun 07 13:12:52.305930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 91/184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:52 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:52.522613 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:52.523627 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:52.533044 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.533498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.534281 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.534699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.674510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.686221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-be7d408b-1db1-475f-86ed-3c674295df11 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.170529 Jun 07 13:12:52.687170 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:52 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:52.713969 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:52.714571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:52.720841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.721313 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.722036 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.722471 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.755448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:52.756048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:52.762438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.762853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.763756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.764210 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.858966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.866614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b9202512-ad9b-4885-b919-33ef2f2cad4f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.156613 Jun 07 13:12:52.867185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 92/186] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:52 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:52.884585 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:52.885228 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:52.891276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.891706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.892471 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:52.892899 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:52.895414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.903611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.905159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:52.906416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fbe6edc7-7d13-4454-8bed-0450f5d1405e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.155247 Jun 07 13:12:52.907173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 95/187] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:52 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:53.036751 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:53.044677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a68f607c-e980-449c-9a42-b99b13c08891 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.163757 Jun 07 13:12:53.045285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 93/188] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:52 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:53.324633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:53.325523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:53.334462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.334911 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.336065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.336666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.473891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:53.481599 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-91354ace-1d4b-498b-80b0-43f7cae6eb3c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.161688 Jun 07 13:12:53.482162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 96/189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:53 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:53.705556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:53.706162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:53.712740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.713278 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.714048 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.714643 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.855095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:53.863246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c27bbe3f-cd53-4bb4-9054-6af739cf2716 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.162692 Jun 07 13:12:53.863827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 94/190] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:53 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:53.883733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:53.884369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:53.891121 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.891624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.892622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.893222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.924329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:53.925044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:53.932106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.932637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:53.933646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:53.934308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.043990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.052584 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-abb7af85-fd3a-48c5-a42c-2c1e8a8a9ada tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.172873 Jun 07 13:12:54.053171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 97/191] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:53 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:54.057734 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-be101b16-5c34-4f01-b313-02a3975fe7ff req-4dc38014-f538-4b28-87a4-e91a455c2dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf", "name": "network-vif-plugged", "status": "completed", "tag": "95c54d86-0d75-40fc-8e67-f43d4eef6799"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:54.066355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-be101b16-5c34-4f01-b313-02a3975fe7ff req-4dc38014-f538-4b28-87a4-e91a455c2dad service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.066798 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-be101b16-5c34-4f01-b313-02a3975fe7ff req-4dc38014-f538-4b28-87a4-e91a455c2dad service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.075054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.078321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-be101b16-5c34-4f01-b313-02a3975fe7ff req-4dc38014-f538-4b28-87a4-e91a455c2dad service nova] Creating event network-vif-plugged:95c54d86-0d75-40fc-8e67-f43d4eef6799 for instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf on hv-cinder-84496 Jun 07 13:12:54.083991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-be101b16-5c34-4f01-b313-02a3975fe7ff req-4dc38014-f538-4b28-87a4-e91a455c2dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029683 Jun 07 13:12:54.084145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.084602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 98/192] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:12:54.086617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.087752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d5ba976d-1890-4c16-8543-ef6a4459e847 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.167916 Jun 07 13:12:54.088388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 95/193] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:53 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:54.089845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:54.090566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:54.097181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.097629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.098394 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.098825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.236322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.244434 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d1d4de22-c9d1-449d-994d-b3f56d1877ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.158490 Jun 07 13:12:54.245043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 99/194] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:54 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:54.498387 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:54.499179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:54.507084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.507515 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.508502 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.508917 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.669729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:54.679281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45c9ad50-0454-434f-8ca5-9dfad44b44f6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.184596 Jun 07 13:12:54.679863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:54 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:54.880433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:54.881149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:54.887884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.888489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:54.889204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:54.889640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.069558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:55.070165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:55.076363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.076807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.077599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.078102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.185580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.198428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f1014409-10d5-4b67-b764-0180405de806 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.322098 Jun 07 13:12:55.199011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 100/196] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:54 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:55.204730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:55.205673 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:55.216340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.217695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.219002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.219808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.325824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.330656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:55.336829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f80c2de-9236-460e-abee-1444a5703120 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.271137 Jun 07 13:12:55.337471 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:55 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:55.342441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:55.343036 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:55.349588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.350238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.351170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.351738 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.431879 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.445472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.447079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.449007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-68b79a72-8366-4033-baa1-9e60e9fed363 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.248412 Jun 07 13:12:55.449699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 101/198] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:55 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:55.551894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.561678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4d38b3bd-0992-476f-9544-651667905258 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.222991 Jun 07 13:12:55.564013 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:55 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:55.697778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:55.698533 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:55.707576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.709843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.710680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:55.711264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:55.890824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:55.901984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-419a4c5d-ea82-429b-819d-bea89ca3658f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.209857 Jun 07 13:12:55.903347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 102/200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:55 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:56.217626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:56.218239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:56.225237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.225895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.226815 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.227424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.357691 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:56.358714 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:56.367009 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.367448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.370280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.370895 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.394922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.406476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-49a9c389-3ab6-4f7e-9a8c-e3f574962425 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.191855 Jun 07 13:12:56.407889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 99/201] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:56 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:56.467783 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:56.468659 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:56.475866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.476574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.477592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.478236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.513594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.522622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-31974f97-84b8-45bf-86bd-13d35613c7b0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.172327 Jun 07 13:12:56.523572 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 103/202] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:56 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:56.583542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:56.584143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:56.592305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.592978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.593960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.594625 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.666373 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.677970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.680815 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.682568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a1298961-0150-45d9-92ab-9348d4e8b725 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.219033 Jun 07 13:12:56.696217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 100/203] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:56 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:12:56.786903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:56.796811 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d6f3cc94-be4a-49ab-946d-8ac86ad2887c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.219521 Jun 07 13:12:56.798537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 104/204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:56 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:56.919388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:56.919991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:56.926315 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.927095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:56.928333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:56.928933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.110473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.118650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d7afe04b-e6c3-4c24-8262-a2d02c0f68ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.202984 Jun 07 13:12:57.119233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 101/205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:56 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:57.427181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:57.427880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:57.439576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.440389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.441422 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.442056 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.539892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:57.540499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:57.548418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.550579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.551519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.552120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.644752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.658939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-23f3371c-df2d-4353-9cb5-b53c4307089d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.238348 Jun 07 13:12:57.661083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 105/206] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:57 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:57.702663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:57.703335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:57.709702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.710648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.711840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.712481 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.895660 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.906575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.909547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.911711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7c31dd2b-1e54-40a4-a9ce-85cc36d21665 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.213611 Jun 07 13:12:57.925959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 106/207] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:57 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:57.931631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:57.932493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:57.939716 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.940168 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.940958 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:57.941456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:57.942364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:57.956962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41843cc4-adaa-4354-bb1b-3346e167da69 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.420524 Jun 07 13:12:57.957680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 102/208] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:57 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:58.090530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:58.099188 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e0f023c9-9a7b-4f98-87c5-151a802877d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.171921 Jun 07 13:12:58.100086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 107/209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:57 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:58.135670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:58.136275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:58.143022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.143469 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.144232 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.144876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.281704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:58.290246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8df262ed-b9a6-43bb-9a57-6560f16f3264 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.158272 Jun 07 13:12:58.291157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:58 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:58.676962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:58.677669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:58.683762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.684195 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.684941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.685409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.822711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:58.830314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-32f95db6-484f-4f56-af38-5c5309e1a549 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.157074 Jun 07 13:12:58.830885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 108/211] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:58 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:58.931413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:58.932876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:58.940029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.940486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.941401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.942216 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.977936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:58.979244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:58.986700 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.987433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:58.988292 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:58.988854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.124323 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.134907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.136440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.137607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-69df9e0c-48e9-488e-a2ee-d10518820624 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.210469 Jun 07 13:12:59.138164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 104/212] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:12:58 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:12:59.141858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.150985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:59.151680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:59.152313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-85206d9d-2581-441a-b3b2-fb8f7900eee7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.182367 Jun 07 13:12:59.153250 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 109/213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:58 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:12:59.158438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.158899 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.159757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.160189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.288402 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.296217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1a9d60a7-466e-40a9-abd2-fb8aa8275dee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.150187 Jun 07 13:12:59.296895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 105/214] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:59 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:59.307729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:59.308331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:59.314926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.315312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.316061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.316489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.453715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:12:59.457463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:12:59.462521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4594aad1-03b2-47ac-9784-a2bc702ddcf6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.158693 Jun 07 13:12:59.463340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 110/215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:59 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:12:59.847519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:12:59.848146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:12:59.855119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.855771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.856905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.857555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.943733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-f0084ab7-c67e-47d4-8c51-52040b80a622 req-e45f47b8-b9c3-4530-a80c-ea82a21b4987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e776100-542e-451a-b985-daa5c5341bfd", "name": "network-vif-plugged", "status": "completed", "tag": "2a4245a9-b510-4749-8d5c-bbc49e30e457"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:12:59.952326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f0084ab7-c67e-47d4-8c51-52040b80a622 req-e45f47b8-b9c3-4530-a80c-ea82a21b4987 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:12:59.953041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f0084ab7-c67e-47d4-8c51-52040b80a622 req-e45f47b8-b9c3-4530-a80c-ea82a21b4987 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:12:59.965194 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-f0084ab7-c67e-47d4-8c51-52040b80a622 req-e45f47b8-b9c3-4530-a80c-ea82a21b4987 service nova] Creating event network-vif-plugged:2a4245a9-b510-4749-8d5c-bbc49e30e457 for instance 3e776100-542e-451a-b985-daa5c5341bfd on hv-cinder-84496 Jun 07 13:12:59.973661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-f0084ab7-c67e-47d4-8c51-52040b80a622 req-e45f47b8-b9c3-4530-a80c-ea82a21b4987 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034332 Jun 07 13:12:59.974503 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 111/216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:00.074781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.082776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5791fcec-aac8-4031-8bc2-8b8073a815cb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.239148 Jun 07 13:13:00.083244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 106/217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:12:59 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:00.156261 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:00.157213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:00.164321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.164987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.165822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.166414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.169917 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:00.171553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:00.177465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.177906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.178779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.179218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.304730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.314312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.315846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.316966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b1b4eecb-8c0f-4fb5-8b11-faab68e95d48 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.164971 Jun 07 13:13:00.317570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 112/218] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:00 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:00.320282 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.322139 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:00.323001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:00.330674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.331085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.331876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.332437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.333566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6c05d207-ebe9-4691-9fe8-31bd20246257 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.167609 Jun 07 13:13:00.334297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:00 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:00.480414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.483148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:00.483964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:00.490080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c978728b-5d24-4ae0-93d5-9e01eb2c98d3 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.171275 Jun 07 13:13:00.490666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:00 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:00.491015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.491470 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.492244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:00.492683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:00.652241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:00.660371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90ebabd2-6d05-4f4f-9b08-5f65791dcacd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.182904 Jun 07 13:13:00.660922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:00 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:01.102314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:01.102891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:01.111036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.111666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.112450 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.112885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.262546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.271349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f2e93d6-b5d7-4a22-905f-60ce0e8ca269 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.174972 Jun 07 13:13:01.271929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:01 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:01.338533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:01.339117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:01.346875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.347357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.348108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.348545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.351794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:01.352707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:01.359529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.360114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.360886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.361334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.487078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.496632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.498217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.499638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-162312cb-e77d-4b9d-9c0b-b5d6fefebd40 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.166767 Jun 07 13:13:01.500191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 109/223] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:01 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:01.513050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.513413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:01.513413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:01.513593 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-12722885-e193-463f-8365-5253e77a66df tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.166090 Jun 07 13:13:01.513813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.514201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 115/224] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:01 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:01.514331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.515027 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.515452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.649749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.658083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-96564eba-38a5-43ab-b642-6c9ef599a336 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.154218 Jun 07 13:13:01.658701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:01 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:01.677055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:01.677700 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:01.683868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.684313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.685146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:01.685578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:01.936463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:01.944277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f4884b3-2d77-4720-9d2d-709229ea8de1 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.271178 Jun 07 13:13:01.944852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 116/226] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:01 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:02.288029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:02.288630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:02.290595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:02.296204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.296645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.297405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.297856 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.431439 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.439462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c8d14af4-86bd-44c0-81c4-15e891c4804c tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.155272 Jun 07 13:13:02.440040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 111/227] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:02 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:02.525383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:02.525383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:02.530821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.531266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.531950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:02.532080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.532505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.533338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:02.540390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.541061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.541931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.542510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.673454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.684126 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.692207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a1cc16a-c7e5-4a50-8d5b-ce4d41215202 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.165454 Jun 07 13:13:02.693729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.694147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 112/228] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:02 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:02.695331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.697064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-36a2d2aa-ff08-4a56-87e3-c7015d2638af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.177148 Jun 07 13:13:02.697822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 117/229] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:02 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:02.700003 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:02.700805 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:02.709532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.710280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.717524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.718116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.860799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:02.868461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-12cd89ca-48d0-44dc-94a9-c2f043cef4db tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.173058 Jun 07 13:13:02.869084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 113/230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:02 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:02.961162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:02.961771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:02.968264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.968904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:02.970134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:02.971105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.136105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.144231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b14e6eeb-e6a4-4c22-b025-b16558838092 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.186800 Jun 07 13:13:03.144811 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 118/231] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:02 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:03.315329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-4777eb3c-7fe7-4d5e-a2f5-aeb9b1373265 req-95506c51-4ecb-465c-813b-43d1e476d480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd04a7-3053-43a2-8e39-d59bb0687ee4", "name": "network-vif-plugged", "status": "completed", "tag": "f1126c3b-69b8-4c60-9364-0df57e08c60a"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:03.324545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4777eb3c-7fe7-4d5e-a2f5-aeb9b1373265 req-95506c51-4ecb-465c-813b-43d1e476d480 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.324952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-4777eb3c-7fe7-4d5e-a2f5-aeb9b1373265 req-95506c51-4ecb-465c-813b-43d1e476d480 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.346508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-4777eb3c-7fe7-4d5e-a2f5-aeb9b1373265 req-95506c51-4ecb-465c-813b-43d1e476d480 service nova] Creating event network-vif-plugged:f1126c3b-69b8-4c60-9364-0df57e08c60a for instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 on hv-cinder-84496 Jun 07 13:13:03.353163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-4777eb3c-7fe7-4d5e-a2f5-aeb9b1373265 req-95506c51-4ecb-465c-813b-43d1e476d480 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041954 Jun 07 13:13:03.357178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 114/232] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:03.456661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:03.457401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:03.466430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.467002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.467887 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.468466 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.612173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.621145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8377b86-8226-441d-aff0-6042793d04b5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.168904 Jun 07 13:13:03.622086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 119/233] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:03 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:03.712744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:03.714057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:03.723512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:03.724326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:03.724458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.724775 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.725603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.726435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.733034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.733785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.734664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.735359 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.736555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:03.897193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.905900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a4a1b55a-705d-4ad9-9e0c-15b7a7d971de tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.197493 Jun 07 13:13:03.906545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 115/234] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:03 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:03.911502 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:03.912186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:03.918829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.919350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.920204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:03.920710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:03.921410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.930626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.932101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:03.933334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-57f09814-d1b0-42c4-98f8-d39f83cb9442 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.214725 Jun 07 13:13:03.934076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 120/235] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:03 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:04.062574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:04.073884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-141e54ba-d91c-431d-bc58-1e884fc69390 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.165789 Jun 07 13:13:04.075279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 116/236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:03 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:04.161881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:04.162484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:04.168516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.168987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.169768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.170198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.310138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:04.317737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a27ab774-e5ea-4573-90c1-259b01134dca tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.159797 Jun 07 13:13:04.318310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 121/237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:04 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:04.639072 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:04.639681 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:04.646460 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.646917 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.647681 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.648111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.781571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:04.794058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0072a497-5c8a-4019-9b9f-d3312adf56fb tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1315 microversion: 2.1 time: 0.158821 Jun 07 13:13:04.794897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 117/238] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:04 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:04.925298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:04.926505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:04.934668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.935105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.936263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.936696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.954139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:04.955586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:04.965716 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.966657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:04.968080 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:04.968695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.097533 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.108839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aee0633a-ce54-4dc8-97ae-d230339e7264 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.189635 Jun 07 13:13:05.109457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 122/239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:04 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:05.114531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:05.115482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:05.122513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.134866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.136130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.141093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.170544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.180627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.182964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.184303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-303df1cb-b327-4c0e-a90b-ac1a927acede tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.236446 Jun 07 13:13:05.185034 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 118/240] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:04 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:05.334909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:05.335495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:05.349650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.350190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.351025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.351353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.353042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.369275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c41d7b68-b2f1-458f-8b1e-36d501bc91b7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.252880 Jun 07 13:13:05.369275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 123/241] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:05 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:05.566473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:05.586352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11f9289a-9214-4378-a8c0-a90c6807e368 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.255183 Jun 07 13:13:05.587771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 119/242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:05 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:05.813563 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:05.814445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:05.821377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.821823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:05.822659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:05.823033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.130405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:06.131236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:06.142221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.142648 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.143413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.143835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.338925 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.348573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60053446-ea43-4ba1-8d73-cbb63c7a122c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.225179 Jun 07 13:13:06.349201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.349792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 120/243] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:06 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:06.359771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e5d5b1ef-77e1-4f7d-973f-23d9d7ee3fe6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1502 microversion: 2.1 time: 0.551260 Jun 07 13:13:06.360577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:05 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:06.362334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:06.362881 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:06.372688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.373329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.374143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.374904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.385262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:06.386080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:06.392850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:06.398554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.399335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.400813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.401473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.525813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.534768 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.536286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.537610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-128687b9-8305-4abb-a348-4287953028b5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.179900 Jun 07 13:13:06.538558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 121/245] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:06 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:06.607831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:06.607831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:06.614377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.615046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.616003 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:06.616507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:06.641936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.673846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9eb76e80-958f-4af6-aba3-7c570c726572 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.295119 Jun 07 13:13:06.677844 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:06 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:06.822242 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:06.834635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-91c8424c-d29a-400c-ad91-86a1b74893bb tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.234576 Jun 07 13:13:06.845877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:06 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:07.365329 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:07.366537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:07.373474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.374255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.375244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.376271 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.545144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:07.553580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-427711f8-41ba-4dbd-a320-e3fbc8cb12a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.192108 Jun 07 13:13:07.554466 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:07 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:07.557204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:07.558451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:07.567192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.567911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.568848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.569311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.695062 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:07.695659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:07.703434 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.703848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.704682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.709200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.785929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:07.795593 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:07.797103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:07.805733 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bc2ea17-db9f-4774-8146-f150453b8ee7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.253799 Jun 07 13:13:07.806552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 123/249] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:07 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:07.852318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:07.853208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:07.863942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.864427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.865234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:07.866015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:07.940051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:07.954806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0c448bb4-eb52-410a-a1c5-0a74884c594d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.263337 Jun 07 13:13:07.956175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:07 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:08.024544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac25054-c3ae-4a1c-87c6-577e250125ff"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:08.026333 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:08.033724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.034568 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:08.036067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.036758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:08.072988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:08.098624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:08.112998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-18cd97a9-1bd9-4bda-87d5-cbdfa6c560a4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.264731 Jun 07 13:13:08.125189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 124/251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:07 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:08.570111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:08.571532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:08.582744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.583188 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:08.583973 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.584400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:08.752449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:08.763284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6fa1353-0922-4ecb-a9b0-aeb0ca01c751 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.196816 Jun 07 13:13:08.764771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 125/252] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:08 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:08.826816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:08.827794 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:08.837518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.839085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:08.840254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:08.840897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.183185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.198779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.202163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.205601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-98a7fc22-df07-4e91-8169-1b0d9dae1790 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.384054 Jun 07 13:13:09.207765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 126/253] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:08 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:13:09.218147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:09.219732 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:09.230035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.231190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.232773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.233865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.461931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.471297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-498be969-a2d3-4054-8ec8-01a157fc8e7c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.261153 Jun 07 13:13:09.471739 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 127/254] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:09 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:09.476713 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:09.477422 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:09.483572 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.484015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.484770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.485390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.638966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.647039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cda6a137-38e4-4609-89ad-888ffdf49693 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.173965 Jun 07 13:13:09.647626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 128/255] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:09 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:09.652216 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-958d06b3-18a2-4df0-8ae3-c9a496a165fe req-f66acc5d-1111-4b29-b45b-766c1d23ef57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5202ff0-c8c1-4c4f-a89c-f536f724298f", "name": "network-vif-plugged", "status": "completed", "tag": "749be2dc-b22c-4710-8386-8d454b1b5992"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:09.660263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-958d06b3-18a2-4df0-8ae3-c9a496a165fe req-f66acc5d-1111-4b29-b45b-766c1d23ef57 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.660705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-958d06b3-18a2-4df0-8ae3-c9a496a165fe req-f66acc5d-1111-4b29-b45b-766c1d23ef57 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.671822 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-958d06b3-18a2-4df0-8ae3-c9a496a165fe req-f66acc5d-1111-4b29-b45b-766c1d23ef57 service nova] Creating event network-vif-plugged:749be2dc-b22c-4710-8386-8d454b1b5992 for instance d5202ff0-c8c1-4c4f-a89c-f536f724298f on hv-cinder-84496 Jun 07 13:13:09.677374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-958d06b3-18a2-4df0-8ae3-c9a496a165fe req-f66acc5d-1111-4b29-b45b-766c1d23ef57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028391 Jun 07 13:13:09.677965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 129/256] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:09.781337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:09.782034 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:09.788641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.789701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.790777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:09.791407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:09.958918 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:09.972302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba1eceab-61f1-48cf-a98c-6cefeadf8fc6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.194935 Jun 07 13:13:09.973258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:09 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:10.225207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:10.225978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:10.239002 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.239463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.242641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.245110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.453506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:10.462350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:10.463936 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:10.465196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4fddf684-3926-43ca-9f71-4008c73d9cfd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.244787 Jun 07 13:13:10.465833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 131/258] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:10 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:10.489902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:10.490626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:10.497442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.498364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.499971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.500978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.524271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:10.657371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:10.670507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1c7aca6e-1081-4d92-a2d9-988718777c75 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.185492 Jun 07 13:13:10.671793 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:10 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:10.682021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:10.682747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:10.689328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.689801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.690967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.691417 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.852767 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:10.866874 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-72ce0caa-fd23-46b6-9d8e-a903af1ab41d tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1314 microversion: 2.1 time: 0.188487 Jun 07 13:13:10.867679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 133/260] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:10 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:10.989687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:10.990393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:10.996626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.997111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:10.998005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:10.998518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.190156 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:11.201185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8408757c-b0a2-452e-a159-b368e3d26c3a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.214891 Jun 07 13:13:11.201798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 134/261] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:10 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:11.484587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:11.485281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:11.493220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.493727 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.494694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.495292 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.677241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:11.689973 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:11.696909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:11.698158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-82b62a65-88b5-4ce0-905c-7cd8aeccb57d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.218261 Jun 07 13:13:11.699652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 135/262] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:11 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:13:11.705910 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:11.706835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:11.714764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.715535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.717103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.717676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.895927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b588a02b-f6df-4e65-aeab-5e5bf5d1a08a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "POST /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.879368 Jun 07 13:13:11.899043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 128/263] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:13:08 2022] POST /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d/os-volume_attachments => generated 194 bytes in 3883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:11.910046 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:11.910740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:11.937635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.942939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.944647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:11.945340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:11.998486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.009947 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4556e4d8-20b1-4790-814f-88d239de20ff tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.309078 Jun 07 13:13:12.012221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 136/264] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:11 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:12.162965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.170890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f6e7ae45-e023-4e2a-b41f-2b01f2779799 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1499 microversion: 2.1 time: 0.270374 Jun 07 13:13:12.171503 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 129/265] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:11 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1499 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:12.228495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:12.231356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:12.254290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.256276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.257143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.259930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.453987 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.467358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c6b74877-9266-422e-a210-0aafaf7e05b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1321 microversion: 2.1 time: 0.252266 Jun 07 13:13:12.469479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 137/266] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:12 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:12.717527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:12.718598 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:12.729165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.730523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.731580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.732398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.794765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:12.795321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:12.803058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.803847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.804848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:12.806321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:12.890247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:13:12.927020 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.940082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.941841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:12.946127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d5a1c12b-ece3-41cc-8ac9-bc5d0530b918 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.234219 Jun 07 13:13:12.956884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 130/267] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:12 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:13.030313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:13.031109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.042532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.043004 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.043766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.044222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.131150 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1008bce6-5125-4a52-ac95-ebe1c1574ab9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 204 len: 0 microversion: 2.1 time: 0.340217 Jun 07 13:13:13.132301 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 138/268] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:13:12 2022] DELETE /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:13:13.141618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:13.143573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.171091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.171740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.172683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.173280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.276161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:13.284206 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1eaa8592-42b6-4d73-b2fd-d786135f3a7f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.259325 Jun 07 13:13:13.295646 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 131/269] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:13 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:13.382816 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-764d3848-fac3-46a7-a5eb-b52ae8552c23 req-479517f6-0cf3-416e-a77e-3a35a3965ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "name": "network-vif-plugged", "status": "completed", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:13.400145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-764d3848-fac3-46a7-a5eb-b52ae8552c23 req-479517f6-0cf3-416e-a77e-3a35a3965ef6 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.400824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-764d3848-fac3-46a7-a5eb-b52ae8552c23 req-479517f6-0cf3-416e-a77e-3a35a3965ef6 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.415603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-764d3848-fac3-46a7-a5eb-b52ae8552c23 req-479517f6-0cf3-416e-a77e-3a35a3965ef6 service nova] Creating event network-vif-plugged:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:13:13.421263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-764d3848-fac3-46a7-a5eb-b52ae8552c23 req-479517f6-0cf3-416e-a77e-3a35a3965ef6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042287 Jun 07 13:13:13.422461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 132/270] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:13.429907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:13.438093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-252b7e58-4552-48c3-891f-6a0079ae0aa4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1505 microversion: 2.1 time: 0.301288 Jun 07 13:13:13.439141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 139/271] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:13 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:13.495215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:13.495991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.503074 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.503788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.504746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.505501 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.662453 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:13.672535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d3780367-9f9d-4321-ab48-1d113f0de8d3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1515 microversion: 2.1 time: 0.181873 Jun 07 13:13:13.673563 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 133/272] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:13 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:13.692339 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:13.693597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.701951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.702456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.703389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.703988 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.733603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'flavor' on Instance uuid 17cd04a7-3053-43a2-8e39-d59bb0687ee4 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:13:13.854063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ad53bf62-744b-4bcc-994b-210207bd0639 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4/action" status: 200 len: 32 microversion: 2.1 time: 0.168525 Jun 07 13:13:13.856118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 140/273] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:13:13 2022] POST /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:13:13.865269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:13.866303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.873078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.873602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.874473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.874975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.966717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:13.967525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:13.977731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.978633 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:13.980261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:13.980710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.026304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.035730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-db66ceb0-b084-4ec9-a4e5-4ce6b46b199c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.175019 Jun 07 13:13:14.036524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 134/274] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:13 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:14.149204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.162530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.164520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.165493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-507f7607-eda7-4370-9023-4cd9ffc496be tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.204830 Jun 07 13:13:14.166347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 141/275] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:14.301940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:14.302544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:14.310679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.311075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.313674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.314217 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.424554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1119704665", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:14.480059 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.490522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-14fdf2b1-d4b0-496c-837c-581d8b4afd88 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1364 microversion: 2.1 time: 0.190457 Jun 07 13:13:14.490522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 135/276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:14 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:14.494195 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:14.495050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:14.498956 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] validate_networks() for None {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:13:14.502726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.521398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.522377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.522822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.699400 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:14.708299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d1dc45f8-28ba-402b-a322-bedf379dcee4 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1505 microversion: 2.1 time: 0.218171 Jun 07 13:13:14.709229 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 136/277] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:14 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:14.846599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:13:14.846993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:13:14.847689 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:13:14.848262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:13:14.848905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:13:14.859513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.860324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.861621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:14.862292 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:14.882583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Getting quotas for project fd3b1d809bab4a86ba53fa492ffa827d. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:13:14.886654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Getting quotas for user 1935cd7481134d1087a2dac4cdeb9ced and project fd3b1d809bab4a86ba53fa492ffa827d. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:13:14.898342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:13:14.900595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:13:14.954902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7095db9f-6768-4e53-a01f-055d112c4cb2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534303 Jun 07 13:13:14.957174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 142/278] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:13:14.966742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f28c0c9-e624-4f30-8282-56d943603130 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:14.967341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f28c0c9-e624-4f30-8282-56d943603130 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.041837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f28c0c9-e624-4f30-8282-56d943603130 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.051475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f28c0c9-e624-4f30-8282-56d943603130 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1215 microversion: 2.1 time: 0.089142 Jun 07 13:13:15.053127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:15.053659 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.062590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 137/279] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:14 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:15.070128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.070670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.071587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.072301 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.188140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:15.188843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.202613 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.203059 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.204022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.204699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.247106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.264105 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-685d6073-2d49-4ac2-b42f-63a7cae0fbdd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.213220 Jun 07 13:13:15.265877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 143/280] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:15 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:15.448636 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.458626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.460252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.461800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fbef1a73-a6eb-42b9-80e0-0054a8a9f30d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.282392 Jun 07 13:13:15.462663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 138/281] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:15 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:15.507849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:15.508798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.522275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.523062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.523955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.524605 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.662933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.670424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21232ba3-c01e-4171-8d2b-1b2f6247610f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1549 microversion: 2.1 time: 0.168021 Jun 07 13:13:15.670997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 144/282] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:15 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:15.687729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:15.688215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.694455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.694901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.695637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.696059 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.725866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:15.726489 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:15.732808 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.733389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.734161 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:15.734591 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:15.776657 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e080eba6-5b45-4e43-bdbf-49f7f246c6b8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092974 Jun 07 13:13:15.777313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 139/283] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:13:15 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:15.863636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:15.871565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-146f9634-ddfb-4e6f-8bc9-921f7e0463c3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1505 microversion: 2.1 time: 0.149974 Jun 07 13:13:15.872150 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 145/284] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:15 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:16.070540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:16.071779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:16.077978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.078399 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.079636 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.080069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.190179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:16.198087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9e2ee04b-b26b-482b-83f2-e436d40a60c7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1219 microversion: 2.1 time: 0.131454 Jun 07 13:13:16.198672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 140/285] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:16 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:16.283153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:16.284220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:16.290806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.291469 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.292236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.292680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.297257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:16.441329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:16.449962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-375cf154-5eee-4dcd-9200-a8fd63bc7825 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.171111 Jun 07 13:13:16.450837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 146/286] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:16 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:16.479964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:16.480811 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:16.499314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.499898 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.502764 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.505178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.889753 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:16.891980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:16.899533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.900277 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:16.901056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:16.901639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:17.042842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.051537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ab96120b-02b7-450e-a796-ac4d2ec282d6 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1505 microversion: 2.1 time: 0.166888 Jun 07 13:13:17.061168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 147/287] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:16 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:17.164275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.172670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.175149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.176364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-004df638-be50-40fa-9bef-f34665f6f511 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.700362 Jun 07 13:13:17.176965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 141/288] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:16 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:17.215418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:17.215931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:17.222394 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:17.222832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:17.223584 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:17.224012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:17.286974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.296352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31641201-f19c-46bf-8800-7aadc2af7d65 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1275 microversion: 2.1 time: 0.084986 Jun 07 13:13:17.296930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 148/289] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:17 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:17.468263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:17.468888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:17.475152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:17.475654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:17.476585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:17.477125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:17.818254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:17.826736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e84716f3-d9e9-41ca-ae9b-17aa9cdb303e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.363482 Jun 07 13:13:17.827408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 142/290] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:17 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:18.069682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:18.070455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:18.078411 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.078867 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.081180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.082180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.097175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-b1be9e78-54d1-4060-b835-e67b0163d296 req-6790959c-6e43-408c-98aa-9eb5381f6ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e776100-542e-451a-b985-daa5c5341bfd", "name": "network-vif-deleted", "tag": "2a4245a9-b510-4749-8d5c-bbc49e30e457"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:18.109680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b1be9e78-54d1-4060-b835-e67b0163d296 req-6790959c-6e43-408c-98aa-9eb5381f6ad9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.110185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-b1be9e78-54d1-4060-b835-e67b0163d296 req-6790959c-6e43-408c-98aa-9eb5381f6ad9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.122191 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-b1be9e78-54d1-4060-b835-e67b0163d296 req-6790959c-6e43-408c-98aa-9eb5381f6ad9 service nova] Creating event network-vif-deleted:2a4245a9-b510-4749-8d5c-bbc49e30e457 for instance 3e776100-542e-451a-b985-daa5c5341bfd on hv-cinder-84496 Jun 07 13:13:18.128256 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-b1be9e78-54d1-4060-b835-e67b0163d296 req-6790959c-6e43-408c-98aa-9eb5381f6ad9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035594 Jun 07 13:13:18.133279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 143/291] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:18.189127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:18.196849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:18.206499 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:18.206728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81fad4a2-2450-40bf-9a53-2cbc9d4bb175 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1463 microversion: 2.1 time: 0.140392 Jun 07 13:13:18.206728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 149/292] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:18 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:18.216602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.217152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.217998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.218503 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.314824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:18.315719 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:18.324868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.325363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.326347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.330586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.476405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:18.491674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4695ac38-56b8-4620-90cd-27793d0746c2 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1285 microversion: 2.1 time: 0.181135 Jun 07 13:13:18.493557 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 150/293] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:18 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:18.602964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:18.619931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:18.630702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:18.633130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f0282f98-3566-4995-8188-c5bd6e4375fe tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1407 microversion: 2.20 time: 0.440478 Jun 07 13:13:18.636383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 144/294] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:18 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:13:18.844273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:18.845344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:18.848308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:18.852897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.853566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:18.854343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:18.854772 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.013389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.021717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-252286bc-6159-4ac4-bae3-802352d18652 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.181660 Jun 07 13:13:19.022304 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 151/295] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:18 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:19.223270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:19.223838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:19.230372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.232340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.233858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.234510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.271390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.272091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.272575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lazy-loading 'fault' on Instance uuid 3e776100-542e-451a-b985-daa5c5341bfd {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:13:19.381065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.394955 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:19.402170 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-da3ba6d9-0e38-4d53-bff0-447998ad271e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 200 len: 1304 microversion: 2.1 time: 0.183160 Jun 07 13:13:19.402956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 145/296] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:19 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:19.511306 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:19.511933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:19.518379 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.518922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.519980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.520423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.583289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.591238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bc4bba9b-d2f0-4340-9f1f-46e97a7c6b67 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1273 microversion: 2.1 time: 0.083751 Jun 07 13:13:19.592046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 152/297] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:19 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:19.653311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:19.654061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:19.667207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.668766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.670569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.671066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.918964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.932969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.934484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:19.935936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79fe1b25-2a12-4fb2-b751-0b69497b0d52 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1597 microversion: 2.20 time: 0.286881 Jun 07 13:13:19.949906 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 146/298] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:13:19 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1597 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:13:19.965823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:19.967856 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:19.978826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.982624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:19.984273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:19.987193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.038939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:20.039888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:20.048615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.049084 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.049889 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.050294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.116593 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9898198a-e7ac-40dd-8e9c-c44628df6094 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.164385 Jun 07 13:13:20.125177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 153/299] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jun 7 13:13:19 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:13:20.168862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-ff0373fd-c940-4de2-b82e-58d92096776a req-b9b6fff2-c382-466b-80af-ae8c4092b538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5202ff0-c8c1-4c4f-a89c-f536f724298f", "tag": "749be2dc-b22c-4710-8386-8d454b1b5992"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:20.193413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ff0373fd-c940-4de2-b82e-58d92096776a req-b9b6fff2-c382-466b-80af-ae8c4092b538 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.194705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-ff0373fd-c940-4de2-b82e-58d92096776a req-b9b6fff2-c382-466b-80af-ae8c4092b538 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.230000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-ff0373fd-c940-4de2-b82e-58d92096776a req-b9b6fff2-c382-466b-80af-ae8c4092b538 service nova] Creating event network-changed:749be2dc-b22c-4710-8386-8d454b1b5992 for instance d5202ff0-c8c1-4c4f-a89c-f536f724298f on hv-cinder-84496 Jun 07 13:13:20.241193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-ff0373fd-c940-4de2-b82e-58d92096776a req-b9b6fff2-c382-466b-80af-ae8c4092b538 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082096 Jun 07 13:13:20.241926 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 154/300] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:20.409248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:20.424935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:20.426033 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: 3e776100-542e-451a-b985-daa5c5341bfd] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:20.434010 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b1c49425-e509-437a-b1fc-4f6da856ba03 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.396382 Jun 07 13:13:20.434630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 147/301] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:20 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:20.446839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.447682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.448758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.449425 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.471042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] HTTP exception thrown: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Request method failure captured: Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd HTTP/1.1 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin064o-KbuvCHcyd0lvykBw8pJPLUzzN3AfeXpKXmO8gVeIGEUl6j-vxMjPqr9WTNGrLwaAVjE8_arfFnAPZRj_J3e2QxoQ4L8WRMk5heSAzmPnyvczA7fVwq3uZEZ2wb-L2FWweRNoqmbHw1dn-t31xSAMXRQ69_PAWEGH-Gul-jvJ4 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 56eca409cb874456afc7f0acc51c7e40 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesActionsTest-367529791 Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:13:20.478607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesActionsTest-367529791 Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 56eca409cb874456afc7f0acc51c7e40 Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesActionsTest-367529791 Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesActionsTest-367529791-project Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: aaefc46a7e6d431c9eebc5233389c61e Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesActionsTest-367529791-project Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. Jun 07 13:13:20.479873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '3e776100-542e-451a-b985-daa5c5341bfd'} Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:20.480545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. Jun 07 13:13:20.481859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:20.484769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Returning 404 to user: Instance 3e776100-542e-451a-b985-daa5c5341bfd could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:20.486432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c984729-62e0-4802-936a-57c3559dd81a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd" status: 404 len: 111 microversion: 2.1 time: 0.069495 Jun 07 13:13:20.498321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 155/302] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:20 2022] GET /compute/v2.1/servers/3e776100-542e-451a-b985-daa5c5341bfd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:20.617437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:20.618155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:20.628658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.628793 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.630578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:20.631203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:20.675019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2106619942", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "networks": [{"uuid": "55fc1070-3007-41c4-b494-234a45a2d448"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:20.743193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] validate_networks() for [('55fc1070-3007-41c4-b494-234a45a2d448', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:13:21.070558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:21.079554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e8f90b63-24a7-4735-8862-083529d92468 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.473729 Jun 07 13:13:21.080475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 148/303] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:20 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:21.454783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:21.456243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:21.473149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:21.473886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:21.475120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:21.475733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:21.674228 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:13:21.674999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:13:21.675660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:13:21.676883 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:13:21.677487 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:13:21.693099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:21.696462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:21.701509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:21.701967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:21.718610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:21.732993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-20fc6aba-6424-4faa-867e-7795c0b46cf9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.283912 Jun 07 13:13:21.737913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 149/304] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:21 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:21.744765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Getting quotas for project 56eca409cb874456afc7f0acc51c7e40. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:13:21.752838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Getting quotas for user aaefc46a7e6d431c9eebc5233389c61e and project 56eca409cb874456afc7f0acc51c7e40. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:13:21.769588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:13:21.773908 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:13:21.853682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ca88fef-7a56-41d7-97b3-b7f74e20c50f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182474 Jun 07 13:13:21.860951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 156/305] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:13:21.866047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d804a579-2b03-4432-90ba-553bec25461a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:21.866920 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d804a579-2b03-4432-90ba-553bec25461a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:21.988213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d804a579-2b03-4432-90ba-553bec25461a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:22.016848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d804a579-2b03-4432-90ba-553bec25461a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1214 microversion: 2.1 time: 0.142289 Jun 07 13:13:22.019691 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 150/306] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:21 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:22.099706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:22.102028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:22.133513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.134914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.137168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.138710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.336781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-86f77ca3-0ad6-4174-8206-d8ef32326ee6 req-4853acbf-5f21-49e3-a093-1e7904f652a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d", "tag": "a1cfa8bf-9c4d-48dd-beff-162d06b1cc09"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:22.351345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-86f77ca3-0ad6-4174-8206-d8ef32326ee6 req-4853acbf-5f21-49e3-a093-1e7904f652a1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.353951 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-86f77ca3-0ad6-4174-8206-d8ef32326ee6 req-4853acbf-5f21-49e3-a093-1e7904f652a1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.382809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-86f77ca3-0ad6-4174-8206-d8ef32326ee6 req-4853acbf-5f21-49e3-a093-1e7904f652a1 service nova] Creating event network-changed:a1cfa8bf-9c4d-48dd-beff-162d06b1cc09 for instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d on hv-cinder-84496 Jun 07 13:13:22.390286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-86f77ca3-0ad6-4174-8206-d8ef32326ee6 req-4853acbf-5f21-49e3-a093-1e7904f652a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058051 Jun 07 13:13:22.392004 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 151/307] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:22.560878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-28a0cf0a-9de9-41e2-9e0c-8cc0baa221de req-9ea6682e-d666-4fde-aa9c-bc898ca35c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:22.582817 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-28a0cf0a-9de9-41e2-9e0c-8cc0baa221de req-9ea6682e-d666-4fde-aa9c-bc898ca35c96 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.584962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-28a0cf0a-9de9-41e2-9e0c-8cc0baa221de req-9ea6682e-d666-4fde-aa9c-bc898ca35c96 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.599930 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-28a0cf0a-9de9-41e2-9e0c-8cc0baa221de req-9ea6682e-d666-4fde-aa9c-bc898ca35c96 service nova] Creating event network-changed:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:13:22.614751 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-28a0cf0a-9de9-41e2-9e0c-8cc0baa221de req-9ea6682e-d666-4fde-aa9c-bc898ca35c96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063361 Jun 07 13:13:22.615579 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 152/308] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:22.656803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:22.665937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bdd6ec77-f6bb-4fdc-8f6f-4cb0ce0dcde3 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.573670 Jun 07 13:13:22.667536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 157/309] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:22 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:22.751708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:22.752570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:22.759148 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.759676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.760546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:22.761225 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:22.911426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:22.924299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a9326976-8e28-49bc-b9ab-a538b3642fc9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.177654 Jun 07 13:13:22.935345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 153/310] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:22 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:23.036322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:23.037056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:23.043363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.043876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:23.044867 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.045643 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:23.116703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:23.124374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4b5d0dc6-7ea5-470f-8dd6-bb03d79a456c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.092314 Jun 07 13:13:23.125781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 158/311] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:23 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:23.684170 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:23.685186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:23.691329 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.691771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:23.692527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.692957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:23.828071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:23.835827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a6b6361b-696a-4296-a1c7-811c9b38d301 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.155755 Jun 07 13:13:23.836551 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:23 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:23.942888 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:23.943664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:23.950703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.951195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:23.951957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:23.952396 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:24.142429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:24.143319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:24.145221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:24.149773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:24.150304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:24.151150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:24.151618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:24.154037 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1577f10e-440d-4d4e-9011-1006fcf6ea60 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.215750 Jun 07 13:13:24.154796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 159/313] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:23 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:24.229477 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:24.245386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-98110221-7ca6-4a20-bb02-1d74451c7556 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.106879 Jun 07 13:13:24.246107 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 155/314] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:24 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:24.853960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:24.854562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:24.861446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:24.862193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:24.862988 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:24.863423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:25.014290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:25.022084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d48f2949-3184-4682-a6cf-200f98c6f21c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.171967 Jun 07 13:13:25.022653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 160/315] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:24 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:25.171739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:25.172344 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:25.179182 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:25.179615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:25.180384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:25.180822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:25.264089 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:25.264823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:25.279625 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:25.280041 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:25.280816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:25.281274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:25.323340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:25.331288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6c44deb4-2e21-4c42-9eec-9fcf585e69ab tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.163418 Jun 07 13:13:25.332027 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:25 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:25.344343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:25.351945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7ed2585-1d3a-411a-a144-1231fce6951c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.092143 Jun 07 13:13:25.352630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 161/317] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:25 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:26.038850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:26.039472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:26.046209 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.046747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.048001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.048565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.205639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:26.213949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5c2800d6-2ceb-4db3-aea3-db0c4b19dd9a tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.179057 Jun 07 13:13:26.214704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 157/318] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:26 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:26.348086 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:26.348661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:26.354892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.355545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.356312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.356848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.369783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:26.370688 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:26.378519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.378967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.379749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:26.380221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:26.444432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:26.452474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2103969e-8868-4f38-ae1e-e6a3109a9586 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.087399 Jun 07 13:13:26.461795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 158/319] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:26 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:26.537025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:26.545267 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09bb7fba-c4ea-46b9-9bf0-5f6ec9251699 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.201324 Jun 07 13:13:26.545950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 162/320] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:26 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:27.231331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:27.232233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:27.239109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.239553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.240327 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.240759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.416348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:27.425550 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-38583cb6-dddc-4e78-93a9-8912fbf494d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.198023 Jun 07 13:13:27.426917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 159/321] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:27 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:27.470658 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:27.471243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:27.487904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.488444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.489370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.489871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.565540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:27.566245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:27.572664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.573123 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.574091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:27.574528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:27.586143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:27.594832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6288c0b2-4e02-40e2-bd22-6d9d70df820c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.128489 Jun 07 13:13:27.596086 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:27 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:27.710334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:27.718021 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2b65a6ad-4569-47cb-8622-9200b8411be8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.156957 Jun 07 13:13:27.718707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 160/323] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:27 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:28.443314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:28.444164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:28.450585 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.451271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.452208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.452800 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.611903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:28.612987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:28.622698 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.623153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.623949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.624396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.658221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:28.667626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57da34f0-df1f-4620-8a26-5d19d9388952 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.228169 Jun 07 13:13:28.681371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 164/324] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:28 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:28.733079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:28.735082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:28.735766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:28.742998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.743695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.744828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:28.745066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de84b967-6456-4d29-a9d3-274314d395c9 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.136999 Jun 07 13:13:28.745619 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:28.755034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 161/325] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:28 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:28.780466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:28.915761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:28.924980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-66e6b53c-91fc-4c04-ad2e-cfa030744d3f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.193005 Jun 07 13:13:28.925600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 165/326] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:28 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:29.685718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:29.686368 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:29.693545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.693990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:29.694934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.695392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:29.770882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:29.771498 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:29.778993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.779438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:29.780196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.780623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:29.851466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:29.861979 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5ed53a11-205b-4243-b80c-8d8273d4023c tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.102408 Jun 07 13:13:29.862784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 166/327] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:29 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:29.942187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:29.942818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:29.953880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.954404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:29.955318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:29.958895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:30.023729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:30.033087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b4d65127-ba78-493f-866b-814b2315331e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.350594 Jun 07 13:13:30.045648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 162/328] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:29 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:30.140189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:30.152419 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4fc26b7c-8c0e-4655-9a0f-17a76797c472 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.214206 Jun 07 13:13:30.158650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 167/329] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:29 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:30.880155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:30.880758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:30.886759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:30.887199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:30.887949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:30.888424 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:30.958023 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:30.967417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6f32484b-1102-4426-affa-4665029615c7 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1266 microversion: 2.1 time: 0.092077 Jun 07 13:13:30.968036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 163/330] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:30 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:31.051858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:31.052428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:31.059707 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:31.060384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:31.061495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:31.061946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:31.171110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:31.172142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:31.183415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:31.183950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:31.184720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:31.185824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:31.334631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:31.339297 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:31.347002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-782d5d32-b7d8-4a4f-ad32-3f220f05d94b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.179278 Jun 07 13:13:31.348400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:31.348697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 164/331] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:31 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:31.356571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3901d57b-2c77-4df1-9c3b-920f6311ac82 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.309633 Jun 07 13:13:31.367142 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 168/332] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:31 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:31.986251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:31.987649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:32.009051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:32.016897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.018300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.020981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.022963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.261528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:32.270900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fe92e877-bb18-462f-a8aa-f93b67e8aad3 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1284 microversion: 2.1 time: 0.289631 Jun 07 13:13:32.278183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 165/333] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:31 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:32.366620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:32.368241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:32.378679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:32.379880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=12 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:32.384074 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.385403 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.386426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.387016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:32.387888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:32.388511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.401186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.405957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.406964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.407532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.614646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:32.623534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-86dadc9d-029e-4d13-9276-9f17d897347b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.262823 Jun 07 13:13:32.624324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 169/334] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:32 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:32.655028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:32.655523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:32.662644 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.663093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.663872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.664358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.694575 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:13:32.810029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8c0b9a53-215b-49db-bef0-bb71635ef2d1 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 204 len: 0 microversion: 2.1 time: 0.158064 Jun 07 13:13:32.814971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 170/335] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:13:32 2022] DELETE /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:13:32.822182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:32.823777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:32.834243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.835375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.836417 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:32.837088 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:32.988078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:32.998036 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2c5db63f-47d1-4d86-a8f3-85e2c07ab531 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1554 microversion: 2.1 time: 0.181568 Jun 07 13:13:32.999038 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:32 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:33.130414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:33.139484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6cf43ad3-27be-40b2-93cf-e66e21d0e4d5 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.764713 Jun 07 13:13:33.141915 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 166/337] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:32 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:33.290059 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:33.290672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:33.300138 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:33.301900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:33.314849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:33.315368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:33.463121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:33.477285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-745ea2bc-aa5c-4c84-9238-8cfdbf11b3b2 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1272 microversion: 2.1 time: 0.192872 Jun 07 13:13:33.478243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:33 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:33.645357 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:33.646276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:33.657393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:33.658200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:33.660179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:33.662314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.003081 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:34.016223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:34.016906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:34.029306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6d9b300-c52f-49d3-ae1b-965398798b0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.392041 Jun 07 13:13:34.030408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 167/339] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:33 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:34.035858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.036668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.037704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.038290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.158011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:34.159230 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:34.182918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.184137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.185511 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.187080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.342025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:34.351817 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fe2dbed8-4334-4945-922d-bc4ee2924c8d tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1554 microversion: 2.1 time: 0.339995 Jun 07 13:13:34.352395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 173/340] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:34 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1554 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:34.495270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:34.496680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:34.507070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.507568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.508382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:34.509226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:34.513673 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:34.531072 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81681d8f-0ebe-4551-aaa5-8fc9bae0742e tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.378002 Jun 07 13:13:34.531633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 168/341] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:34 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:34.724780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:34.748514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-acf75260-fc03-40c8-92d9-d6ca388fc722 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.257017 Jun 07 13:13:34.749837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 174/342] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:34 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:34.980144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-1ac05c15-0af1-4e3d-ae5b-c9cdc9890b02 req-336bf496-d659-4b26-b85a-1b7033beadc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d", "name": "network-vif-plugged", "status": "completed", "tag": "a1cfa8bf-9c4d-48dd-beff-162d06b1cc09"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:35.008921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1ac05c15-0af1-4e3d-ae5b-c9cdc9890b02 req-336bf496-d659-4b26-b85a-1b7033beadc3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.009839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1ac05c15-0af1-4e3d-ae5b-c9cdc9890b02 req-336bf496-d659-4b26-b85a-1b7033beadc3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.033264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-1ac05c15-0af1-4e3d-ae5b-c9cdc9890b02 req-336bf496-d659-4b26-b85a-1b7033beadc3 service nova] Creating event network-vif-plugged:a1cfa8bf-9c4d-48dd-beff-162d06b1cc09 for instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d on hv-cinder-84496 Jun 07 13:13:35.039566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-1ac05c15-0af1-4e3d-ae5b-c9cdc9890b02 req-336bf496-d659-4b26-b85a-1b7033beadc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066859 Jun 07 13:13:35.040307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 169/343] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:35.063772 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:35.066454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:35.078756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.079480 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.080360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.080898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.310642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:35.326675 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88be57c6-9d9b-4831-a620-09b4a3401aaa tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.284544 Jun 07 13:13:35.327717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 175/344] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:35 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:35.373522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:35.378310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:35.387609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.388865 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.390374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.391018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.555346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:35.556525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:35.582196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.582784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.583672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.584865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.906025 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:35.924104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ce96d1ce-a83d-40c1-b382-f2dabb6fd613 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1554 microversion: 2.1 time: 0.553178 Jun 07 13:13:35.927797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:35.935039 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:35 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1554 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:35.938051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0c3ca408-5324-4c32-b019-16799cbce27c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.393794 Jun 07 13:13:35.945593 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:35 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:35.945772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:35.959367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:35.973032 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.975315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:35.977005 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:35.978507 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.346032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:36.346195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:36.365629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.366259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.367199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.367792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.428473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:36.440535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-715b2079-4c04-4740-9ec2-7a755bb68681 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.504207 Jun 07 13:13:36.443945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 171/347] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:35 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:36.724581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:36.733711 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b060ba9a-fbf2-40ad-94ee-819af404b3be tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.393683 Jun 07 13:13:36.738641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:36 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:36.874103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-cfcad982-9555-4392-91d8-432cf6d3a1d7 req-aa634d64-2348-4174-b54e-b6c799ae6dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6648081-0c07-46ee-99a6-720a8618c571", "tag": "3a943c45-ca48-4071-a726-81257a66b971"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:36.885776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=99 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:36.894773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-cfcad982-9555-4392-91d8-432cf6d3a1d7 req-aa634d64-2348-4174-b54e-b6c799ae6dce service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.895625 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-cfcad982-9555-4392-91d8-432cf6d3a1d7 req-aa634d64-2348-4174-b54e-b6c799ae6dce service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.921680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-cfcad982-9555-4392-91d8-432cf6d3a1d7 req-aa634d64-2348-4174-b54e-b6c799ae6dce service nova] Creating event network-changed:3a943c45-ca48-4071-a726-81257a66b971 for instance d6648081-0c07-46ee-99a6-720a8618c571 on hv-cinder-84496 Jun 07 13:13:36.935408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-cfcad982-9555-4392-91d8-432cf6d3a1d7 req-aa634d64-2348-4174-b54e-b6c799ae6dce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065110 Jun 07 13:13:36.943923 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:36.944628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:36.947715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 172/349] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:36.951271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.963000 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:36.963707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:36.965640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.966863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.967699 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.977803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.978249 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:36.979029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:36.979578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.076764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:37.087597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2977030e-0c8a-46d8-9c83-984c0e57b98a tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1512 microversion: 2.1 time: 0.147925 Jun 07 13:13:37.110011 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 178/350] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:36 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:37.117611 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-e4571773-6355-4327-b1e3-3e6beb21b2e2 req-3a0726fb-a88d-4272-a395-97a7a901f1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202ded4-7dfd-4c8c-880d-5a3bf04a494d", "name": "network-vif-deleted", "tag": "9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:37.131238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e4571773-6355-4327-b1e3-3e6beb21b2e2 req-3a0726fb-a88d-4272-a395-97a7a901f1e4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:37.132409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-e4571773-6355-4327-b1e3-3e6beb21b2e2 req-3a0726fb-a88d-4272-a395-97a7a901f1e4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.163556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-e4571773-6355-4327-b1e3-3e6beb21b2e2 req-3a0726fb-a88d-4272-a395-97a7a901f1e4 service nova] Creating event network-vif-deleted:9a7de2cd-b0e6-45c3-ac11-0ae96590f2f3 for instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d on hv-cinder-84496 Jun 07 13:13:37.170523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-e4571773-6355-4327-b1e3-3e6beb21b2e2 req-3a0726fb-a88d-4272-a395-97a7a901f1e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058813 Jun 07 13:13:37.171625 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 179/351] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:37.255959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:37.265249 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-15e0cc0f-1942-490c-baf9-173c556b818f tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1315 microversion: 2.1 time: 0.306529 Jun 07 13:13:37.275541 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 173/352] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:36 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:37.461288 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:37.462483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:37.475132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:37.476219 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.479403 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:37.483796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.669436 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:37.673290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:37.685028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3164045-565e-416e-9965-cdab9ed9c110 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.228442 Jun 07 13:13:37.685643 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 180/353] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:37 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:37.755984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:37.757357 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:37.763634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:37.764279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.765071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:37.765694 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:37.992921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:38.002517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3c825e78-5f42-4a0f-b4e9-6a7e62dd5edc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.250347 Jun 07 13:13:38.020449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 174/354] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:37 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:38.115206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:38.116066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:38.131484 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.132149 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.133569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.134215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.179356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.179964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.181176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lazy-loading 'fault' on Instance uuid 5202ded4-7dfd-4c8c-880d-5a3bf04a494d {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:13:38.269409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc103ff7fb9342179a7ce6404315afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f90a27e69c7441ea20216b40281fdba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:38.287613 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:38.288173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:38.300478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.300929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.304608 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-430ed286-ffb2-4915-8619-a52c288e82b6 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 200 len: 1351 microversion: 2.1 time: 0.193138 Jun 07 13:13:38.305904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 181/355] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:38 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 1351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:38.306489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.307263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.602697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:38.617874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0ba671d7-0cef-4a81-8708-a12698962a2c tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1464 microversion: 2.1 time: 0.338492 Jun 07 13:13:38.619071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 175/356] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:38 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:38.679938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:38.681106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:38.693180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.695141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.698220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.698734 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.702084 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:38.702701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:38.709884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.710781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.711848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.712486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.747113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:13:38.919569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c281f5d0-a7da-4ed1-90d2-de3e07cfcfef tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 204 len: 0 microversion: 2.1 time: 0.249886 Jun 07 13:13:38.924166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 182/357] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:13:38 2022] DELETE /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:13:38.932676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:38.933409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:38.948017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.948461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:38.949267 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:38.949977 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.103727 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:39.112174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-422b4e0e-96f8-4b03-8266-12e9f10fea90 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1470 microversion: 2.1 time: 0.183841 Jun 07 13:13:39.117094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 183/358] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:38 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:39.117935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:39.118689 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:39.128629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.129115 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.129890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.130321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.239689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:39.259011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c43edb6-d556-48fe-8e05-c162d8cd2496 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.560688 Jun 07 13:13:39.259619 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 176/359] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:38 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:39.294390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:39.302701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ec74194-ab8a-493a-a21f-ddf4e5320aad tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.188735 Jun 07 13:13:39.304162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 184/360] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:39 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:39.322971 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:39.323805 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:39.331043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.331496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.332360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.332791 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.347822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] HTTP exception thrown: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Request method failure captured: Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d HTTP/1.1 Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06VPBvMhu0kd20s7W-3PbetsjIDrw3gSsubu1sIh5Ui_V2x0PDrXkd2IlBzlWiaJ-eFUgvMaLrnwzWigU2N4wBp9NUmYYc1mk3G43eItMkfuQsUuaxKCTOhld1scH-LIf88V10zLN7UF2oRTytMT886VZmsGqicb9wyII3gDuswChg Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:13:39.353624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bc103ff7fb9342179a7ce6404315afed Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.355122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '5202ded4-7dfd-4c8c-880d-5a3bf04a494d'} Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:39.355874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.357306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.358493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Returning 404 to user: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:39.358493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5c5ed2e4-1ded-4308-ad53-597e64f0f3d5 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 404 len: 111 microversion: 2.1 time: 0.036948 Jun 07 13:13:39.358493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 177/361] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:39 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:39.461409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:39.463321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:39.469956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.470593 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.471378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:39.471812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:39.485069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] HTTP exception thrown: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Request method failure captured: Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d/os-volume_attachments HTTP/1.1 Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06VPBvMhu0kd20s7W-3PbetsjIDrw3gSsubu1sIh5Ui_V2x0PDrXkd2IlBzlWiaJ-eFUgvMaLrnwzWigU2N4wBp9NUmYYc1mk3G43eItMkfuQsUuaxKCTOhld1scH-LIf88V10zLN7UF2oRTytMT886VZmsGqicb9wyII3gDuswChg Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:13:39.487436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bc103ff7fb9342179a7ce6404315afed Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.488864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '5202ded4-7dfd-4c8c-880d-5a3bf04a494d'} Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:39.489616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:39.490670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:39.491755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Returning 404 to user: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:39.491755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-913c8de8-844e-4b03-adab-0bc7a0cfd179 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032708 Jun 07 13:13:39.491755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 178/362] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:13:39 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:13:39.523476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-29b3232d-c27d-49a1-9e68-1058c3d58a32 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Action: 'create', calling method: .version_select at 0x7f20a49ace50>, body: {"keypair": {"name": "tempest-TestShelveInstance-753366998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw3R0gQ/SYz7s3CMuiRl70FDRW310cftvUMRDjBGA7Xxe7A5lnz/j68afy+QxfuTFDdb/ERrOQ7j8Y6w5es41O9U9u+eQh85WLNR1elsQ5oHokvA5eYg0Qpp5XExbsVfQ=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:39.542983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-29b3232d-c27d-49a1-9e68-1058c3d58a32 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Getting quotas for project 01f471802c1e4d5393928e42b59b2962. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:13:39.545221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:39.556364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-29b3232d-c27d-49a1-9e68-1058c3d58a32 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Getting quotas for user f75d5fe118b348098ac701778e552da7 and project 01f471802c1e4d5393928e42b59b2962. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:13:39.597113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-29b3232d-c27d-49a1-9e68-1058c3d58a32 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.263721 Jun 07 13:13:39.598435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 185/363] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:13:39 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:40.134340 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:40.136355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:40.143839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.144506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.145334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.145908 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.282191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:40.283612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:40.302467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.303761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.305198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.306490 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.334067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:40.342141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-502d011a-ae26-4634-b4aa-18d07d6a99f0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1470 microversion: 2.1 time: 0.214379 Jun 07 13:13:40.342974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 179/364] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:40 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:40.360303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:40.361267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:40.368346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.369071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.370009 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.370600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.558235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:40.580196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7b3744f7-ff79-4237-908b-f8c4dc47cb5e tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.307960 Jun 07 13:13:40.592728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 186/365] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:40 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:40.621276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:40.637403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-720419ce-5644-4a26-8049-a34bc2413e64 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.282011 Jun 07 13:13:40.650180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 180/366] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:40 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:40.729438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:40.730118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:40.736601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.737069 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.737838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.738415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.756974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] HTTP exception thrown: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Request method failure captured: Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d HTTP/1.1 Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06VPBvMhu0kd20s7W-3PbetsjIDrw3gSsubu1sIh5Ui_V2x0PDrXkd2IlBzlWiaJ-eFUgvMaLrnwzWigU2N4wBp9NUmYYc1mk3G43eItMkfuQsUuaxKCTOhld1scH-LIf88V10zLN7UF2oRTytMT886VZmsGqicb9wyII3gDuswChg Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:13:40.759197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bc103ff7fb9342179a7ce6404315afed Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.760456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '5202ded4-7dfd-4c8c-880d-5a3bf04a494d'} Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:40.761220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.765904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.767095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Returning 404 to user: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:40.767095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc1dd94c-9124-4735-81ba-665dfa650d00 tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 404 len: 111 microversion: 2.1 time: 0.035297 Jun 07 13:13:40.767095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 187/367] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:13:40 2022] DELETE /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:40.770773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:40.771383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] [instance: 5202ded4-7dfd-4c8c-880d-5a3bf04a494d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:40.778178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.778801 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.780355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:40.780788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:40.797656 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] HTTP exception thrown: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Request method failure captured: Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d HTTP/1.1 Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06VPBvMhu0kd20s7W-3PbetsjIDrw3gSsubu1sIh5Ui_V2x0PDrXkd2IlBzlWiaJ-eFUgvMaLrnwzWigU2N4wBp9NUmYYc1mk3G43eItMkfuQsUuaxKCTOhld1scH-LIf88V10zLN7UF2oRTytMT886VZmsGqicb9wyII3gDuswChg Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:13:40.799269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f90a27e69c7441ea20216b40281fdba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 3f90a27e69c7441ea20216b40281fdba Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-DeleteServersTestJSON-1220422411 Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bc103ff7fb9342179a7ce6404315afed Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-DeleteServersTestJSON-1220422411-project Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.800718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '5202ded4-7dfd-4c8c-880d-5a3bf04a494d'} Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:40.801542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. Jun 07 13:13:40.802825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:40.804736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] Returning 404 to user: Instance 5202ded4-7dfd-4c8c-880d-5a3bf04a494d could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:40.805537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7165f7e6-0c56-4c7a-93db-c37d052e713e tempest-DeleteServersTestJSON-1220422411 tempest-DeleteServersTestJSON-1220422411-project] 10.222.0.20 "GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d" status: 404 len: 111 microversion: 2.1 time: 0.040216 Jun 07 13:13:40.806106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 181/368] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:40 2022] GET /compute/v2.1/servers/5202ded4-7dfd-4c8c-880d-5a3bf04a494d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:41.362327 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:41.363128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:41.377865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:41.378224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:41.393765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:41.394220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:41.599645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:41.604984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:41.653454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:41.653454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:41.653454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:41.653454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:41.993760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:42.008352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:42.009704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fd4437f9-9bda-4fe7-b91e-0b1f922644b7 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1470 microversion: 2.1 time: 0.648282 Jun 07 13:13:42.010349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 188/369] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:41 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:42.017796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f9c04546-624d-404e-93f8-7507e2ba7f17 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.422958 Jun 07 13:13:42.026526 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:42.027145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:42.027988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 182/370] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:41 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:42.034780 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-dc0f4fc5-e24d-46b1-ade2-28c76d1e170d req-6a33ee30-deea-4821-a6b7-c8e66b77c18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d", "name": "network-vif-deleted", "tag": "a1cfa8bf-9c4d-48dd-beff-162d06b1cc09"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:42.041725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:42.042181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:42.042972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:42.048051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:42.055175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dc0f4fc5-e24d-46b1-ade2-28c76d1e170d req-6a33ee30-deea-4821-a6b7-c8e66b77c18e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:42.055786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-dc0f4fc5-e24d-46b1-ade2-28c76d1e170d req-6a33ee30-deea-4821-a6b7-c8e66b77c18e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:42.081110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-dc0f4fc5-e24d-46b1-ade2-28c76d1e170d req-6a33ee30-deea-4821-a6b7-c8e66b77c18e service nova] Creating event network-vif-deleted:a1cfa8bf-9c4d-48dd-beff-162d06b1cc09 for instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d on hv-cinder-84496 Jun 07 13:13:42.089394 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-dc0f4fc5-e24d-46b1-ade2-28c76d1e170d req-6a33ee30-deea-4821-a6b7-c8e66b77c18e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059867 Jun 07 13:13:42.090010 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 183/371] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:42.319785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:42.328749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-feb83832-2778-457c-a7bb-9e12ccbe6f2e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.314263 Jun 07 13:13:42.332337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 189/372] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:42 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:43.027835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:43.028526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:43.034857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:43.035602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:43.039809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.040253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.041038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.042230 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.042696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.043145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.043915 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.044351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.116325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:43.124601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-71a2b712-7f54-4a37-93aa-cfd0324e0ad0 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1428 microversion: 2.1 time: 0.101381 Jun 07 13:13:43.131794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 184/373] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:43 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:43.232609 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:43.243806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-018bc97d-2b70-4eec-a1ec-b969da59dc61 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.212722 Jun 07 13:13:43.244623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 190/374] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:43 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:13:43.351814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:43.352442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:43.358946 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.359388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.360459 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:43.361388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:43.381661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:43.532208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:43.540469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0964921f-bcd2-413a-b9be-89d461661577 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.196037 Jun 07 13:13:43.541069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 185/375] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:43 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:43.628901 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-db9ca512-1454-4613-b760-9c08c905a870 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Action: 'create', calling method: .version_select at 0x7f20a49ac310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-487157483"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:43.945431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-db9ca512-1454-4613-b760-9c08c905a870 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.447848 Jun 07 13:13:43.946130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 191/376] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Jun 7 13:13:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 449 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 13:13:43.958393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-698fbd0f-3930-457e-882c-ab6a6fb5e1ca tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a4949430>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:44.038996 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-698fbd0f-3930-457e-882c-ab6a6fb5e1ca tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 200 len: 344 microversion: 2.1 time: 0.084365 Jun 07 13:13:44.039605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 186/377] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:43 2022] GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:44.142458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:44.143037 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:44.150174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.150892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.151872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.152307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.187727 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.188283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.188938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lazy-loading 'fault' on Instance uuid 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:13:44.231451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1935cd7481134d1087a2dac4cdeb9ced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3b1d809bab4a86ba53fa492ffa827d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:44.240146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-18b99ed6-2349-4f1d-afbb-7e3080a506ea tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 200 len: 1305 microversion: 2.1 time: 0.101583 Jun 07 13:13:44.240826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 192/378] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:44 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:44.263560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:44.264178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:44.284036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.284475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.285280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.285710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.425578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:44.434412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4a636604-29ba-4835-9dca-c7d437150876 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.175083 Jun 07 13:13:44.434991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 187/379] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:44 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:44.557405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:44.558008 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:44.564718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.565413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.567506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:44.568121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:44.735853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:44.745265 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2fb06756-4156-4b95-b397-5d72df4c8378 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.191571 Jun 07 13:13:44.746039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 193/380] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:44 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:45.052439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f79eba65-6d71-4464-8636-dbde9e74e7ef tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a48e9b80>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.107727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f79eba65-6d71-4464-8636-dbde9e74e7ef tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 200 len: 345 microversion: 2.1 time: 0.059887 Jun 07 13:13:45.108321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 188/381] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.119939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-973dbb98-27c5-45e4-8a13-98e50a7aa9a8 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Action: 'create', calling method: .version_select at 0x7f20a485a3a0>, body: {"snapshot": {"volume_id": "2d47bd47-516d-43f9-a5c7-623dd6b1887c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1660659762"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:45.258221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.258941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] [instance: 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:45.265411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.266000 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.267066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.267840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.284122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] HTTP exception thrown: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Request method failure captured: Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d HTTP/1.1 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin07oyKdSBr2fTh5fWaSXoFLOVNsWKJZQK8vgeWgR-iHzztZPXCkcRdyJTuyIzYLMYr4ULZwJOlXsrSTACV7JWv_ZgVjaVftHVaZx00mmBEIK8MjBpWI06jpNVsRq5v6MSKwJuh93TVLH5qF-I-sXbOhCt5QIb2jL_DmwKbfkSWtkPv8 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: fd3b1d809bab4a86ba53fa492ffa827d Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-332661267 Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:13:45.286089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd3b1d809bab4a86ba53fa492ffa827d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd3b1d809bab4a86ba53fa492ffa827d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd3b1d809bab4a86ba53fa492ffa827d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd3b1d809bab4a86ba53fa492ffa827d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-332661267 Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: fd3b1d809bab4a86ba53fa492ffa827d Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-332661267 Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-332661267-project Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 1935cd7481134d1087a2dac4cdeb9ced Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-332661267-project Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. Jun 07 13:13:45.287398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d'} Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:45.288262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. Jun 07 13:13:45.289432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:45.290647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] Returning 404 to user: Instance 2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:45.290647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-02375432-7394-4078-8d96-7e3c7d178897 tempest-VolumesNegativeTest-332661267 tempest-VolumesNegativeTest-332661267-project] 10.222.0.20 "GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d" status: 404 len: 111 microversion: 2.1 time: 0.033857 Jun 07 13:13:45.290647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 189/382] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/servers/2bc78b2b-bcd8-4f13-916d-e3f9c4d3a88d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:13:45.297054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-973dbb98-27c5-45e4-8a13-98e50a7aa9a8 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.177403 Jun 07 13:13:45.297054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 194/383] 10.222.0.20 () {60 vars in 1161 bytes} [Tue Jun 7 13:13:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.308540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cc2acda2-a81c-4298-a96b-a59c4059d3a8 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49491f0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.338277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cc2acda2-a81c-4298-a96b-a59c4059d3a8 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.035635 Jun 07 13:13:45.338882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 190/384] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.349926 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f78fe010-ffc3-45e8-b8cf-cceaa66b7541 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49058b0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.380363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f78fe010-ffc3-45e8-b8cf-cceaa66b7541 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034804 Jun 07 13:13:45.380996 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 195/385] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.391215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b601367e-ff76-4261-8439-13f0554f42ed tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a4a2c790>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.425007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b601367e-ff76-4261-8439-13f0554f42ed tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.037547 Jun 07 13:13:45.425652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 191/386] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:45.451346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.451941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:45.459935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.460446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.461283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.461756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.602620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:45.618098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37497ad0-29e7-4323-9deb-2d3c108a3f00 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.170398 Jun 07 13:13:45.619227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:45.771637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:45.772297 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:45.780837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.781387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.782277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:45.782795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:45.917954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:45.927757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cd12f7a0-8176-4170-b80f-e866b1fcc7b6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.160862 Jun 07 13:13:45.928330 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:45 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:46.440912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6277e605-a7a2-45b5-805e-7e4fd044542a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49ac280>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:46.473096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6277e605-a7a2-45b5-805e-7e4fd044542a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.038077 Jun 07 13:13:46.473675 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 197/389] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:46.638296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:46.638913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:46.646260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:46.646607 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:46.647406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:46.647942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:46.781446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:46.789867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47152e37-60e5-4ce3-aa5b-89b4a615d706 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.157499 Jun 07 13:13:46.790442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 193/390] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:46.945536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:46.946141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:46.953197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:46.953621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:46.954637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:46.955085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:47.091113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:47.099553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b13636ab-989d-4d11-805a-8afb9bcc551e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.158095 Jun 07 13:13:47.100154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 198/391] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:46 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:47.485520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5aead25-2e3b-41a2-83eb-82b2d23266d7 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49055e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.516093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d5aead25-2e3b-41a2-83eb-82b2d23266d7 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.034765 Jun 07 13:13:47.516806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 194/392] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:47.811058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:47.811691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:47.818395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:47.818843 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:47.819703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:47.820130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:47.966204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:47.973821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-08e39425-fe5c-4cc3-9c71-13aafa3ee704 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.167691 Jun 07 13:13:47.974412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 199/393] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:47 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:48.118377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.119042 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:48.125889 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:48.126334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:48.127095 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:48.127633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:48.270260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:48.278105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f38de60-90fb-48a5-b592-e65c5c6da34a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.164465 Jun 07 13:13:48.278671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 195/394] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:48.528046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b72c89ff-8e2b-4f64-bcd7-b1f19da2ae8a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a485a5e0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.557052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b72c89ff-8e2b-4f64-bcd7-b1f19da2ae8a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.032691 Jun 07 13:13:48.557597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 200/395] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:48.991820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:48.992510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:48.999074 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:49.000774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:49.001527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:49.002071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:49.135710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:49.143341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a0da6e62-23bd-4de3-acc4-7d86cbeb75ec tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.156351 Jun 07 13:13:49.143884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 196/396] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:48 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:49.295573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:49.296177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:49.303195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:49.303840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:49.304758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:49.305605 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:49.445383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:49.448964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:49.453907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ffa0ad79-a2bd-4d34-ad72-d66bf68f13d0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.162381 Jun 07 13:13:49.454465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 201/397] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:49 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:49.571187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2d54c3e1-bc6a-457f-b3c9-c72fb9e2daad tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a4a2c0d0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:49.601310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2d54c3e1-bc6a-457f-b3c9-c72fb9e2daad tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.035884 Jun 07 13:13:49.604321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 197/398] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:49 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:50.160375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.160994 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:50.163235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:50.169896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.170362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.171190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.171614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.308145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:50.316311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a4146b7d-88cb-4efb-9261-da6529f07022 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.159828 Jun 07 13:13:50.316885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 202/399] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:50.471596 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.472245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:50.480064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.480064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.480064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:50.480441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:50.617222 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4077d5d4-79bb-48e3-ad1a-0b79ad701087 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49ac9d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:50.619325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:50.627714 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dc100a84-7333-4d1c-9913-2af0f529af89 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.160587 Jun 07 13:13:50.628281 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 198/400] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:50.650736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4077d5d4-79bb-48e3-ad1a-0b79ad701087 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.037334 Jun 07 13:13:50.651528 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 203/401] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:50 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:51.336078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:51.336597 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:51.343144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:51.343588 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:51.344341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:51.344766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:51.487981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:51.499372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a9968421-f01c-4bef-800e-54abe37b4089 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.168354 Jun 07 13:13:51.500589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 199/402] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:51 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:51.645741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:51.646388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:51.653519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:51.653969 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:51.654742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:51.655179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:51.662819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a6e6828e-6142-4600-b0ed-fb5047a9143a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49051f0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:51.696741 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a6e6828e-6142-4600-b0ed-fb5047a9143a tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.037628 Jun 07 13:13:51.697354 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 200/403] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:51 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:51.793430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:51.801179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60565681-55ad-4475-8f4b-0f7ac302ba53 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.159363 Jun 07 13:13:51.801726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 204/404] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:51 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:52.519253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:52.519802 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:52.527753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.528197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.528964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.529432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.682382 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:52.690030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f6cb22f-916c-43fc-a8a4-a07fe2bf6dac tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.176671 Jun 07 13:13:52.690602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 201/405] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:52 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:52.707752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-308ba771-85d1-43d1-b169-57293b362a0d tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49ac940>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:52.738235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-308ba771-85d1-43d1-b169-57293b362a0d tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.034231 Jun 07 13:13:52.738792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 205/406] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:52 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:52.821153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:52.821657 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:52.830611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.831057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.831821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:52.832252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:52.972425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:52.980131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-213a9d67-41a0-41d0-9033-0e0104a95fc0 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.163916 Jun 07 13:13:52.980733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 202/407] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:52 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:53.408709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-b68b4dee-5f71-445d-9852-4fd479c0f410 req-ed51b9dd-3bb6-4059-b637-e16cc0288470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6648081-0c07-46ee-99a6-720a8618c571", "name": "network-vif-plugged", "status": "completed", "tag": "3a943c45-ca48-4071-a726-81257a66b971"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:53.418180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b68b4dee-5f71-445d-9852-4fd479c0f410 req-ed51b9dd-3bb6-4059-b637-e16cc0288470 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:53.418642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-b68b4dee-5f71-445d-9852-4fd479c0f410 req-ed51b9dd-3bb6-4059-b637-e16cc0288470 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:53.430753 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-b68b4dee-5f71-445d-9852-4fd479c0f410 req-ed51b9dd-3bb6-4059-b637-e16cc0288470 service nova] Creating event network-vif-plugged:3a943c45-ca48-4071-a726-81257a66b971 for instance d6648081-0c07-46ee-99a6-720a8618c571 on hv-cinder-84496 Jun 07 13:13:53.435731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-b68b4dee-5f71-445d-9852-4fd479c0f410 req-ed51b9dd-3bb6-4059-b637-e16cc0288470 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Jun 07 13:13:53.436346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 206/408] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:53.707159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.708412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:53.715815 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:53.716264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:53.717163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:53.717571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:53.751536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6409d67f-6765-45e9-b910-9a91b9c61701 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a4905ca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.782340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6409d67f-6765-45e9-b910-9a91b9c61701 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 288 microversion: 2.1 time: 0.035528 Jun 07 13:13:53.782912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 207/409] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:53.792964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ecf9f4b3-d453-40d3-8700-5a4f265ea806 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a485aaf0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.851065 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ecf9f4b3-d453-40d3-8700-5a4f265ea806 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 202 len: 0 microversion: 2.1 time: 0.061889 Jun 07 13:13:53.851582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:53.851845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 208/410] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Jun 7 13:13:53 2022] DELETE /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:13:53.860789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce7259c4-ad77-405f-9ac9-3a24d9095505 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a485a700>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:53.862234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5c0d9fc6-ce72-478f-a5f6-b39f6be95a74 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.158877 Jun 07 13:13:53.862819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 203/411] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:53.890645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce7259c4-ad77-405f-9ac9-3a24d9095505 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 200 len: 287 microversion: 2.1 time: 0.034514 Jun 07 13:13:53.891213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 209/412] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:13:54.000058 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.000727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:54.010128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.010727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:54.011809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.012353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:54.151172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:54.159234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-384c5dd2-3efd-4586-9494-030d9ede58f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.165499 Jun 07 13:13:54.160033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 204/413] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:53 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:54.882579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.883405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:54.893864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.894336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:54.895544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:54.897287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:54.902737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af7e7c92-685a-45f9-bfe3-9b40b3c81dd1 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a48f2310>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:54.931143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-af7e7c92-685a-45f9-bfe3-9b40b3c81dd1 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] HTTP exception thrown: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af7e7c92-685a-45f9-bfe3-9b40b3c81dd1 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Request method failure captured: Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 HTTP/1.1 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin08H4JVQtoZhUJRNlxoNmLCPk5usyxMracX-23MVrhtcKIQroiot4Ii_MGSXT62LHmpu7wzp7XZzGp4RCxkP_IiXXjCr2mArgw0_5H2Yu5DTRXWbF_brPuN8BMwgHdFbhJZyu4ev-FlQRXE4fy0OWGt1Umv0yn7P4JtnRyUePxl3i4U Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:13:54.934303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: b8c49ea93c79464c846988c205704ac8 Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'a06e937f-9bf5-416a-807c-996073fab155'} Jun 07 13:13:54.935609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. (HTTP 404) (Request-ID: req-77d1b713-0fdd-4216-81da-4a3aaff7165c) Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.936585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:54.937945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 13:13:54.939654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af7e7c92-685a-45f9-bfe3-9b40b3c81dd1 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Returning 404 to user: Snapshot a06e937f-9bf5-416a-807c-996073fab155 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af7e7c92-685a-45f9-bfe3-9b40b3c81dd1 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155" status: 404 len: 111 microversion: 2.1 time: 0.037003 Jun 07 13:13:54.941571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 205/414] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/os-snapshots/a06e937f-9bf5-416a-807c-996073fab155 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:54.944765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8e31c56a-d59c-4d76-9fdf-d2f49ed026ea tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a4915790>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.020105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8e31c56a-d59c-4d76-9fdf-d2f49ed026ea tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 202 len: 0 microversion: 2.1 time: 0.079265 Jun 07 13:13:55.020674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 206/415] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:13:54 2022] DELETE /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:13:55.030087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11997c1c-e312-409d-9170-fcf682a7cfcb tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a49e35e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.049977 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:55.058256 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fe6b908b-edbd-4ae7-8abe-c493c7a4c82f tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1314 microversion: 2.1 time: 0.182467 Jun 07 13:13:55.059536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 210/416] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:54 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:55.085418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-11997c1c-e312-409d-9170-fcf682a7cfcb tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 200 len: 344 microversion: 2.1 time: 0.059556 Jun 07 13:13:55.086064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:55 2022] GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:55.176890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:55.177543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:55.183993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:55.184441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:55.185266 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:55.185704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:55.333396 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:55.345233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-921064d5-31c6-43a0-954b-7e74f6d97fc1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.169808 Jun 07 13:13:55.345233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 211/418] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:55 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:56.076212 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.077495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:56.083805 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.084246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.084990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.085459 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.098408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fcd6179-3c14-40a4-8625-7e5be4c7a04e tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a48d1310>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.128771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-6fcd6179-3c14-40a4-8625-7e5be4c7a04e tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] HTTP exception thrown: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fcd6179-3c14-40a4-8625-7e5be4c7a04e tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Request method failure captured: Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c HTTP/1.1 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin08H4JVQtoZhUJRNlxoNmLCPk5usyxMracX-23MVrhtcKIQroiot4Ii_MGSXT62LHmpu7wzp7XZzGp4RCxkP_IiXXjCr2mArgw0_5H2Yu5DTRXWbF_brPuN8BMwgHdFbhJZyu4ev-FlQRXE4fy0OWGt1Umv0yn7P4JtnRyUePxl3i4U Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:13:56.131145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: b8c49ea93c79464c846988c205704ac8 Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '2d47bd47-516d-43f9-a5c7-623dd6b1887c'} Jun 07 13:13:56.132549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. (HTTP 404) (Request-ID: req-e7fb50b6-3509-4c98-9dd5-1b75ce780871) Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.136190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.137488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:13:56.138694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.139950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.141623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6fcd6179-3c14-40a4-8625-7e5be4c7a04e tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Returning 404 to user: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:56.142483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6fcd6179-3c14-40a4-8625-7e5be4c7a04e tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 404 len: 109 microversion: 2.1 time: 0.048082 Jun 07 13:13:56.143053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 212/419] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:56.157607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40811b04-2899-418c-bf7f-68a8f5535e16 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a485ab80>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.191552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-40811b04-2899-418c-bf7f-68a8f5535e16 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] HTTP exception thrown: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40811b04-2899-418c-bf7f-68a8f5535e16 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Request method failure captured: Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c HTTP/1.1 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin08H4JVQtoZhUJRNlxoNmLCPk5usyxMracX-23MVrhtcKIQroiot4Ii_MGSXT62LHmpu7wzp7XZzGp4RCxkP_IiXXjCr2mArgw0_5H2Yu5DTRXWbF_brPuN8BMwgHdFbhJZyu4ev-FlQRXE4fy0OWGt1Umv0yn7P4JtnRyUePxl3i4U Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:13:56.193891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: b8c49ea93c79464c846988c205704ac8 Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '2d47bd47-516d-43f9-a5c7-623dd6b1887c'} Jun 07 13:13:56.195331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. (HTTP 404) (Request-ID: req-4fdba676-bd96-4ed1-961c-fa3d31c9fdf0) Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.196244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:13:56.197472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:13:56.198709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-40811b04-2899-418c-bf7f-68a8f5535e16 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Returning 404 to user: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:56.199873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-40811b04-2899-418c-bf7f-68a8f5535e16 tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 404 len: 109 microversion: 2.1 time: 0.042186 Jun 07 13:13:56.200762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 213/420] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:13:56 2022] DELETE /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:56.204905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d69f39aa-e771-45fc-8924-ca1d761222ab tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Calling method '.version_select at 0x7f20a48d1160>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.232735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-d69f39aa-e771-45fc-8924-ca1d761222ab tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] HTTP exception thrown: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d69f39aa-e771-45fc-8924-ca1d761222ab tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Request method failure captured: Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c HTTP/1.1 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin08H4JVQtoZhUJRNlxoNmLCPk5usyxMracX-23MVrhtcKIQroiot4Ii_MGSXT62LHmpu7wzp7XZzGp4RCxkP_IiXXjCr2mArgw0_5H2Yu5DTRXWbF_brPuN8BMwgHdFbhJZyu4ev-FlQRXE4fy0OWGt1Umv0yn7P4JtnRyUePxl3i4U Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:13:56.234700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c22cd26ffe194abc9dbb794acb48a4d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: c22cd26ffe194abc9dbb794acb48a4d0 Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-870259904 Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: b8c49ea93c79464c846988c205704ac8 Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-870259904-project Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '2d47bd47-516d-43f9-a5c7-623dd6b1887c'} Jun 07 13:13:56.236124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. (HTTP 404) (Request-ID: req-6bbfc76b-adb5-436c-8861-50bddb6d2f16) Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.236974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:13:56.238179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:13:56.239376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. Jun 07 13:13:56.240519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:13:56.241792 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:56.242348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d69f39aa-e771-45fc-8924-ca1d761222ab tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] Returning 404 to user: Volume 2d47bd47-516d-43f9-a5c7-623dd6b1887c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:13:56.242348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d69f39aa-e771-45fc-8924-ca1d761222ab tempest-VolumesSnapshotsTestJSON-870259904 tempest-VolumesSnapshotsTestJSON-870259904-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c" status: 404 len: 109 microversion: 2.1 time: 0.035184 Jun 07 13:13:56.242348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 214/421] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/os-volumes/2d47bd47-516d-43f9-a5c7-623dd6b1887c => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:13:56.245235 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-01fcbe92-0f00-409d-b03d-a7dfb9c26972 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1498 microversion: 2.1 time: 0.173364 Jun 07 13:13:56.245802 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 208/422] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:56.360726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.361646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:56.370255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.371220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.372691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.373176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.524200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:56.533062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc63d002-c883-4a41-8176-6c7eb718de80 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.177119 Jun 07 13:13:56.533962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 215/423] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:56.820242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.820992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:56.827851 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.828308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.829132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.829564 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.857599 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:13:56.949610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b414a699-d41d-4145-b471-191af153d250 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 204 len: 0 microversion: 2.1 time: 0.133929 Jun 07 13:13:56.950208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 209/424] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:13:56 2022] DELETE /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:13:56.959758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:56.960476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:56.966797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.967494 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:56.968397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:56.968849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:57.110913 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:57.121318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4ec67055-0fed-4f99-8ac2-8695a7c14936 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1504 microversion: 2.1 time: 0.165313 Jun 07 13:13:57.121869 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 216/425] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:56 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:57.550880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:57.551553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:57.558441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:57.558916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:57.559674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:57.560120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:57.696855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:57.704389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f827ca7f-5511-43ba-a3b4-44fe706b6191 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.157704 Jun 07 13:13:57.704927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 210/426] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:57 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:58.138646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:58.139243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:58.145323 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:58.145762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:58.146516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:58.146924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:58.295321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:58.304904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-84ebb576-f76f-4e95-bc5a-1260e9e36aee tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1504 microversion: 2.1 time: 0.170164 Jun 07 13:13:58.305687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 217/427] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:58 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:58.722140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:58.723525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:58.730819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:58.731268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:58.732037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:58.732478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:58.736832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:13:58.873579 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:58.883391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f54f461-7df4-4982-9393-00f46939f76e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.165209 Jun 07 13:13:58.884224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 211/428] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:58 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:59.321699 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:59.322148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:59.329527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.330471 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:59.331145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.331561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:59.613387 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:13:59.622398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9e984a05-f1e7-47a3-a80d-7ed7a18c1777 tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1504 microversion: 2.1 time: 0.304329 Jun 07 13:13:59.623050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 218/429] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:59 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:13:59.774405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-6e5bb445-e8fb-4072-aefe-3900014bf95d req-77d2290b-b389-4f80-9ea8-deded48411ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6648081-0c07-46ee-99a6-720a8618c571", "name": "network-vif-deleted", "tag": "3a943c45-ca48-4071-a726-81257a66b971"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:13:59.784534 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6e5bb445-e8fb-4072-aefe-3900014bf95d req-77d2290b-b389-4f80-9ea8-deded48411ba service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.784996 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6e5bb445-e8fb-4072-aefe-3900014bf95d req-77d2290b-b389-4f80-9ea8-deded48411ba service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:59.797146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-6e5bb445-e8fb-4072-aefe-3900014bf95d req-77d2290b-b389-4f80-9ea8-deded48411ba service nova] Creating event network-vif-deleted:3a943c45-ca48-4071-a726-81257a66b971 for instance d6648081-0c07-46ee-99a6-720a8618c571 on hv-cinder-84496 Jun 07 13:13:59.802393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-6e5bb445-e8fb-4072-aefe-3900014bf95d req-77d2290b-b389-4f80-9ea8-deded48411ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032436 Jun 07 13:13:59.802998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 212/430] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:13:59.903245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:13:59.903990 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:13:59.913173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.913959 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:13:59.915235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:13:59.915870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:00.077377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:00.085104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-795e596a-5b1b-4814-99a4-ea644873685a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.187999 Jun 07 13:14:00.085689 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 219/431] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:13:59 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:00.640872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:00.641871 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:00.648628 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:00.649135 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:00.650258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:00.650703 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:00.722561 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:00.730586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a3d11c93-59bf-452d-894c-3f615abdae9b tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1462 microversion: 2.1 time: 0.094341 Jun 07 13:14:00.731319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 213/432] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:00 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:01.102205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:01.103132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:01.110824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.111322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.112123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.112556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.295622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:01.309281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8dfd6fb5-b84b-40e5-adf0-b06e0ed85602 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.211040 Jun 07 13:14:01.310271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 220/433] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:01 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:01.748253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:01.750067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:01.757164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.757698 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.759011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.760127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.794406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:01.795114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:01.795557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lazy-loading 'fault' on Instance uuid d6648081-0c07-46ee-99a6-720a8618c571 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:14:01.896364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaefc46a7e6d431c9eebc5233389c61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56eca409cb874456afc7f0acc51c7e40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:01.904968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6eebcb92-5ab0-4c7e-bb39-353299825f4a tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 200 len: 1304 microversion: 2.1 time: 0.160720 Jun 07 13:14:01.905541 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 214/434] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:01 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:02.327000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:02.327571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:02.334617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:02.335220 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:02.335961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:02.336386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:02.482669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:02.490311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-97b6d16a-0b5e-4c63-90f0-1d5970030d82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.167205 Jun 07 13:14:02.490886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 221/435] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:02 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:02.922024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:02.922658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] [instance: d6648081-0c07-46ee-99a6-720a8618c571] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:02.929040 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:02.929487 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:02.930246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:02.930758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:02.945567 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] HTTP exception thrown: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Request method failure captured: Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 HTTP/1.1 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin064o-KbuvCHcyd0lvykBw8pJPLUzzN3AfeXpKXmO8gVeIGEUl6j-vxMjPqr9WTNGrLwaAVjE8_arfFnAPZRj_J3e2QxoQ4L8WRMk5heSAzmPnyvczA7fVwq3uZEZ2wb-L2FWweRNoqmbHw1dn-t31xSAMXRQ69_PAWEGH-Gul-jvJ4 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 56eca409cb874456afc7f0acc51c7e40 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesActionsTest-367529791 Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:14:02.948360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_56eca409cb874456afc7f0acc51c7e40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesActionsTest-367529791 Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 56eca409cb874456afc7f0acc51c7e40 Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesActionsTest-367529791 Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesActionsTest-367529791-project Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: aaefc46a7e6d431c9eebc5233389c61e Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesActionsTest-367529791-project Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. Jun 07 13:14:02.950559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'd6648081-0c07-46ee-99a6-720a8618c571'} Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:14:02.951234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. Jun 07 13:14:02.952346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:02.953582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] Returning 404 to user: Instance d6648081-0c07-46ee-99a6-720a8618c571 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:14:02.953582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-64e11d2d-2f55-4ee9-bf37-c1319ae55bcd tempest-VolumesActionsTest-367529791 tempest-VolumesActionsTest-367529791-project] 10.222.0.20 "GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571" status: 404 len: 111 microversion: 2.1 time: 0.032345 Jun 07 13:14:02.953582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 215/436] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:02 2022] GET /compute/v2.1/servers/d6648081-0c07-46ee-99a6-720a8618c571 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:14:03.509508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:03.511066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:03.518123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:03.521269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:03.522153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:03.522580 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:03.680559 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:03.688665 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c32548ff-7623-47a9-a685-e83bb196826b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1521 microversion: 2.1 time: 0.183787 Jun 07 13:14:03.689356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 222/437] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:03 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:04.705876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:04.706511 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:04.714069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:04.714510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:04.715702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:04.716235 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:04.853903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:04.861609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d982ed00-7f62-4d9c-b189-c2467298d9bf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1501 microversion: 2.1 time: 0.159728 Jun 07 13:14:04.862282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 216/438] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:04 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:04.878071 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:04.878679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:04.884785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:04.885478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:04.886241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:04.886677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:05.063193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:05.071951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b86ec98-055a-4f53-8f65-ca0c89a712f1 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1515 microversion: 2.1 time: 0.197852 Jun 07 13:14:05.072753 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 223/439] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:04 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:10.666123 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:10.667130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:10.673126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:10.675058 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.675612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.676785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.677579 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.703706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'flavor' on Instance uuid d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:14:10.822543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e8baf684-d2d7-4fe6-b775-35bdac47c7a5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/action" status: 200 len: 32 microversion: 2.1 time: 0.159840 Jun 07 13:14:10.822994 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 217/440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:14:10 2022] POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:14:10.834031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:10.835374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:10.839391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:10.843096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.843814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.844833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:10.845796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:10.997752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:11.014958 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-baaf6d60-5d0e-4f69-ae36-e7c2ab4cfcf4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.185582 Jun 07 13:14:11.015553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 224/441] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:10 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:12.035918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:12.036713 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:12.043215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.043765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.044583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:12.045115 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:12.239155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:12.248520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fb07f226-6ba0-49e5-8c13-042cadc62d8d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.219416 Jun 07 13:14:12.250166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 218/442] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:12 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:13.279629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:13.281822 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:13.299343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.303157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:13.304473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:13.304927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:13.737206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:13.749845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4df2c753-2476-4fad-a5b9-b15febc41e39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.485647 Jun 07 13:14:13.750847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 225/443] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:13 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:14.768040 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:14.768641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:14.775818 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:14.776264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:14.777057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:14.777495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:14.915798 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:14.923961 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a335db93-ac19-4e52-b9df-2c538d104d21 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.159814 Jun 07 13:14:14.924530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 219/444] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:14 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:15.945466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:15.946523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:15.956880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.957585 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:15.958853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:15.959574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:16.094125 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:16.105247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7fb53ed-d344-456c-977c-df9e89013486 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.166604 Jun 07 13:14:16.105844 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 226/445] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:15 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:17.125086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:17.125808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:17.135250 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.135706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.136471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:17.136938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:17.267682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:17.276246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-43369209-454b-4e1d-b25a-f127d31bcb7e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.157164 Jun 07 13:14:17.276829 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 220/446] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:17 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:18.294671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:18.295208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:18.301798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.302248 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:18.303018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:18.303457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:18.307438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:18.455641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:18.466650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bb8810de-e380-461a-a778-a7d53103cea4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.176626 Jun 07 13:14:18.467401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 227/447] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:18 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:19.487232 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:19.488692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:19.495664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.496195 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.497175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:19.497765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:19.631767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:19.640118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d979a220-8648-4515-9384-f697796daeef tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.156473 Jun 07 13:14:19.650736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 221/448] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:19 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:20.660186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:20.661451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:20.668360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.668896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.670175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:20.671020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:20.908381 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:20.925132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27820d05-87a3-4adb-864a-0ca0a3a52c71 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.270926 Jun 07 13:14:20.935997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 228/449] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:20 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:21.946404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:21.947259 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:21.957689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.958890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:21.960425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:21.961114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:22.525562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:22.533717 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-23495533-028a-4b4e-be19-60e32b6e45ff tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.593174 Jun 07 13:14:22.534294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 222/450] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:21 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:23.552488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:23.553311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:23.577742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.578577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.579631 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:23.580280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:23.789846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:23.799596 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-13368281-d550-4123-92f8-418b7a9e3329 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.251781 Jun 07 13:14:23.800397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 229/451] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:23 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:24.817050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:24.818871 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:24.830444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.830885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.831872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:24.832706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:24.978913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:24.988672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fecd65e5-b7a8-44f0-8261-6058547aaee3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.175292 Jun 07 13:14:24.989665 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 223/452] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:24 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:25.037199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1466443782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-753366998", "security_groups": [{"name": "tempest-secgroup-smoke-796533789"}], "networks": [{"uuid": "e927b5aa-e75d-4f00-91ef-6579b0776138"}], "block_device_mapping_v2": [{"uuid": "314d8bf6-3049-4924-affc-8adce452f1f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:25.149833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] validate_networks() for [('e927b5aa-e75d-4f00-91ef-6579b0776138', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:25.646511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:25.647287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:25.647819 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:25.648848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:25.649306 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:25.659767 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.660209 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.661141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:25.661581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:25.679912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Getting quotas for project 01f471802c1e4d5393928e42b59b2962. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:25.684420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Getting quotas for user f75d5fe118b348098ac701778e552da7 and project 01f471802c1e4d5393928e42b59b2962. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:25.746012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:25.751882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='314d8bf6-3049-4924-affc-8adce452f1f5',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:25.923714 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3a4cb5bc-3891-491a-a04d-760b502af547 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.890300 Jun 07 13:14:25.924375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 230/453] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:14:25.936125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9797b961-ec0e-4659-9d5b-78530630b566 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:25.937419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9797b961-ec0e-4659-9d5b-78530630b566 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:26.007064 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:26.007682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:26.015725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.016177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.017051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:26.017428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:26.041664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9797b961-ec0e-4659-9d5b-78530630b566 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.056432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9797b961-ec0e-4659-9d5b-78530630b566 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1088 microversion: 2.1 time: 0.123523 Jun 07 13:14:26.057184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 224/454] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:25 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1088 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:26.254792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:26.263051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11533bbe-bb07-48eb-9cbf-b955d52ce051 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.260804 Jun 07 13:14:26.264374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 231/455] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:26 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:27.074775 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.075373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.082524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.083411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.084335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.084855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.146241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.153733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5223d503-7563-45da-89e1-339673bf8178 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1138 microversion: 2.1 time: 0.083398 Jun 07 13:14:27.154285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 225/456] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:27.285433 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:27.286419 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:27.296553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.296980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.298381 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:27.298882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:27.451358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:27.459290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d0b24775-6f5b-4663-8c00-3e38f70c141e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.180871 Jun 07 13:14:27.459859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 232/457] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:27 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:28.170612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.171209 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.177787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.178218 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.178983 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.179412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.248795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.257140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f6c5b38-3099-4bba-bb74-299dd6348e02 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1130 microversion: 2.1 time: 0.090612 Jun 07 13:14:28.258547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 226/458] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1130 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:28.476806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:28.477442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:28.483797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.484242 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.484997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:28.485459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:28.621925 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:28.629950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dfb1bcc7-04bc-4f39-a128-c5da0481b59a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.157032 Jun 07 13:14:28.630520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 233/459] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:28 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:29.275553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.276199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.283552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.283975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.284966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.285638 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.288381 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:29.352382 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.360158 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-07a32423-cf63-49bd-98fc-00cdb4cef44d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1130 microversion: 2.1 time: 0.088570 Jun 07 13:14:29.360723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 227/460] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1130 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:29.647798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:29.648374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:29.655206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.655654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.656407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:29.656837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:29.794077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:29.804770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdfca529-fc91-4961-9fb3-c485ca15e9dc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.160572 Jun 07 13:14:29.805724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 234/461] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:29 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:30.380683 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.381729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.391117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.391561 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.392332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.392766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.472513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:30.482588 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a525b911-e337-4df6-8574-9c97d8c2b68f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1186 microversion: 2.1 time: 0.107809 Jun 07 13:14:30.483781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 228/462] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:30.826443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:30.827657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:30.837943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.838760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.839826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:30.840496 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:30.996016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.005816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-844a4304-789e-4886-84ac-d760c94e5dc3 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.186086 Jun 07 13:14:31.013174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 235/463] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:30 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:31.501865 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:31.502562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:31.523029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.523029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.523029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:31.523029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:31.633064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:31.642536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d8010102-4469-49c6-8b44-d8def75014fa tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1194 microversion: 2.1 time: 0.145668 Jun 07 13:14:31.651681 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 229/464] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:31 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:32.025984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.026872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.034533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.034976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.036288 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.036725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.208313 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.221952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fee993d5-b407-46e5-b1bf-8858d494cf1e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.199731 Jun 07 13:14:32.222574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 236/465] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:32.661781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:32.662278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:32.679284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.679751 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.680540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:32.680974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:32.911734 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:32.931731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc09c0ad-ee77-4eb9-a857-6ba9aa28c229 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1194 microversion: 2.1 time: 0.274796 Jun 07 13:14:32.932321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 230/466] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:32 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:33.242757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.243692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.253163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.254997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.254997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.254997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.445032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:33.453517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09caa7b3-1f04-4dec-9305-77181bdb119a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.214666 Jun 07 13:14:33.463101 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 237/467] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:33.952808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:33.953809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:33.968675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.969180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:33.969970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:33.970405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.206122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.218834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-567299bc-ab6e-4cc6-8730-25fc445774e7 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1271 microversion: 2.1 time: 0.273191 Jun 07 13:14:34.223341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 231/468] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:33 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:34.473478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:34.474899 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:34.506334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.508461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.514376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:34.514932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:34.845863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:34.856517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09ca0d8a-1135-4545-9935-be9465781011 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.389553 Jun 07 13:14:34.866565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 238/469] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:34 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:35.259997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.261409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.281884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.282604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.286074 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.289126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.338343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-94c11e35-4b7c-4057-a56e-4e233ddb5476 req-50c35342-21fc-4e83-bba0-0b6b8dbe27c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:35.377606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-94c11e35-4b7c-4057-a56e-4e233ddb5476 req-50c35342-21fc-4e83-bba0-0b6b8dbe27c7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.378619 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-94c11e35-4b7c-4057-a56e-4e233ddb5476 req-50c35342-21fc-4e83-bba0-0b6b8dbe27c7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.399447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-94c11e35-4b7c-4057-a56e-4e233ddb5476 req-50c35342-21fc-4e83-bba0-0b6b8dbe27c7 service nova] Creating event network-changed:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:14:35.419395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-94c11e35-4b7c-4057-a56e-4e233ddb5476 req-50c35342-21fc-4e83-bba0-0b6b8dbe27c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111130 Jun 07 13:14:35.424037 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 239/470] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:14:35.728960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:35.739854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ae04f1bd-25e6-43b0-b021-4408b1382a9c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1271 microversion: 2.1 time: 0.499098 Jun 07 13:14:35.742376 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 232/471] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:35.881250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:35.882456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:35.894107 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:35.894793 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:35.907278 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.909359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:35.910612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:35.911287 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.107142 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.119076 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c57964c-b9d1-4c3f-8907-bb58580b75f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1501 microversion: 2.1 time: 0.239267 Jun 07 13:14:36.133074 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 240/472] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:35 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:36.146914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3952cbe-4d52-4c61-9011-cf1fc852bf2b"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:36.148184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.151480 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:36.155779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.156271 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.157156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.157834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.189985 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] HTTP exception thrown: Cannot 'attach_volume' instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf while it is in vm_state rescued Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Request method failure captured: Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/os-volume_attachments HTTP/1.1 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 74 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06eGuqdRjbH-nvavcHPNBP1PuSaoAGC1cl3LGhVXw_niqaD6gUKqcfjfBZan1ImohNd1oD-sYDqHSthN0-lDH07HJNroW8eWYlGmTddNxMaNBRusvdJxp1S-mUhe9r6DSFaeetXaa7BYiZbvPeZLzPB3nj9xjGj82Z6wQ_Mx4b2jNU Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:14:36.191957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9cf247a413d45049be49368cbce7213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9cf247a413d45049be49368cbce7213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 025ca1d10d5e49e984c7fd4e0b425f08 Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {"volumeAttachment": {"volumeId": "c3952cbe-4d52-4c61-9011-cf1fc852bf2b"}} Jun 07 13:14:36.193407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Cannot 'attach_volume' instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf while it is in vm_state rescued Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': 'd65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf', 'body': {'volumeAttachment': {'volumeId': 'c3952cbe-4d52-4c61-9011-cf1fc852bf2b'}}} Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:14:36.194202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf while it is in vm_state rescued Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:14:36.195482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf while it is in vm_state rescued Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Returning 409 to user: Cannot 'attach_volume' instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf while it is in vm_state rescued {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-da8edc98-cb1e-4879-bfca-51575122a2d6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060397 Jun 07 13:14:36.197744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 233/473] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:14:36 2022] POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:14:36.205524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:36.206051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.214133 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.214579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.215352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.215777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.292237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f188466f-8c9f-4e29-b63d-7b12b30fcc43 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.088717 Jun 07 13:14:36.293268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 241/474] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:14:36 2022] POST /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:14:36.301841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.302444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.308968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.309318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.310243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.310816 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.462829 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.471276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-06ebf960-acee-4eba-95f8-81e8a1facc34 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.173229 Jun 07 13:14:36.472091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 234/475] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:36.761534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:36.762245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:36.771051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.771500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.772249 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:36.772679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:36.969236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:36.980400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-283bd48a-b917-49d8-a517-6816f1110779 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.224559 Jun 07 13:14:36.981000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 242/476] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:36 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:37.489843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:37.491077 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:37.499797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.500474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.501599 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:37.502294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:37.729146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:37.741164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-08a173c1-2d77-4969-8a9b-a0cfef71db0d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.255478 Jun 07 13:14:37.742968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 235/477] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:37 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:37.998011 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:37.999110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.005579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.006136 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.007095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.009704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.144041 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.151718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2796b083-a2c9-4e64-8e79-b95737591b42 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.157606 Jun 07 13:14:38.152285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 243/478] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:37 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:38.764312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:38.764967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:38.771705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.772157 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.772927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:38.773400 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:38.911471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:38.919075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-66024718-1ccf-4030-98cf-ed8a073a1313 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.161702 Jun 07 13:14:38.919749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 236/479] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:38 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:39.167896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.168520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.177031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.177687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.178484 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.179943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.187508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:39.329639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:39.340663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6fa1f7e-dfde-4d88-9b39-36ef10941bec tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.176739 Jun 07 13:14:39.341367 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 244/480] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:39.939372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:39.939930 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:39.947175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.947649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:39.948436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:39.948888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.090883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.099080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-65b452b1-b329-45c4-a120-b15f591a052b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.165112 Jun 07 13:14:40.099631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 237/481] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:39 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:40.361522 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:40.362548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:40.372867 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.374106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.374950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:40.375396 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:40.512644 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:40.520654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2727db18-8ab8-433a-bd5e-bcf3b6d2d9fd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.165717 Jun 07 13:14:40.521253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 245/482] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:40 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:41.120591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.121641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.125115 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=44 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:41.130827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.131273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.132047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.132479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.276786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.285061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f902b01c-6bf1-45c4-befe-f9c3231174cf tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.170950 Jun 07 13:14:41.285623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 238/483] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:41.537025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:41.537649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:41.539546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:41.545089 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.545834 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.546716 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:41.547189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:41.688653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:41.696991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a6c59dd-dcfc-49df-9e70-b336dafe6e00 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.163900 Jun 07 13:14:41.697578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 246/484] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:41 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:42.305372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:42.306275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:42.317605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.318346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.319602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.320322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.457615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.469602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-087037a2-e9f7-4804-b4f6-420951301dbc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.170144 Jun 07 13:14:42.470479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 239/485] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:42 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:42.718085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:42.719044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:42.725698 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.726143 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.726911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:42.727343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:42.879802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:42.892020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2da62b53-1080-4639-8777-4027fbf64010 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.180068 Jun 07 13:14:42.892850 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 247/486] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:42 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:43.496156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.497546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.505355 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.505962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.507180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.507820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.656270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:43.663938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19d0f6ea-0d04-40b2-8319-ef89efbde767 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1509 microversion: 2.1 time: 0.174236 Jun 07 13:14:43.664505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 240/487] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:43.914223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:43.914993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:43.922041 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.922513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:43.923258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:43.923690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.061981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.070191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c99663b0-8976-4ecb-9d2a-23c91f343dd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.160575 Jun 07 13:14:44.070770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 248/488] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:43 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:44.681554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:44.682131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:44.689042 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.689492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.690251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:44.690669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:44.835001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:44.842566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb00388b-83e5-4cf4-a6cf-225c391246c7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1515 microversion: 2.1 time: 0.164885 Jun 07 13:14:44.843421 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:44 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:45.086919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:45.088283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:45.095612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.096395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.097407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:45.098039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:45.383153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:45.392225 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d76e1276-7928-46b3-88f7-0a2c9fa17796 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.308989 Jun 07 13:14:45.392912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 249/490] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:45 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:46.410514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:46.411149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:46.417841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.418289 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.419059 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:46.419494 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:46.556418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:46.564491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6576aec5-7e9f-4004-834b-ef1d0257f9e6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.158084 Jun 07 13:14:46.565075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 242/491] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:46 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:47.583293 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:47.583897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:47.590545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.591020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.591796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:47.592203 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:47.732189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:47.740938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d867d34-8eb3-462e-99d6-2d8a19039de5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.162263 Jun 07 13:14:47.741642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 250/492] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:47 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:48.764467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:48.765141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:48.772172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.772558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.773398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:48.773827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:48.915589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:48.923238 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-afc0dbde-2f34-4029-b5db-9b8dab7473d4 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.163380 Jun 07 13:14:48.924497 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 243/493] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:48 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:49.359888 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fcfa9afc-f35b-4e48-8f96-47193662e320 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: .version_select at 0x7f20a49acc10>, body: {"keypair": {"name": "tempest-keypair-1047912438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlboMbbh8XXRkeiG2fxGeLp5m/Tp16FTePtHqhfPk+rRbVCe7wm+w+Sa5BBFIModUwNXevRby29tz/EDd65Gz6UiO0DpkFRZmv+LXwU2J4/5UCoAOPiGqxrtCgyAFFUpw=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:49.374798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-fcfa9afc-f35b-4e48-8f96-47193662e320 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for project f9cf247a413d45049be49368cbce7213. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:49.379746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-fcfa9afc-f35b-4e48-8f96-47193662e320 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for user 025ca1d10d5e49e984c7fd4e0b425f08 and project f9cf247a413d45049be49368cbce7213. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:49.404937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fcfa9afc-f35b-4e48-8f96-47193662e320 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049022 Jun 07 13:14:49.405745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 251/494] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:14:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:49.941980 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:49.942667 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:49.949486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.949929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.950719 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:49.951457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:49.954163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:14:50.162901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:50.177305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0eddc979-f8cf-4b47-a343-ec5501f6a626 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.238480 Jun 07 13:14:50.186505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 244/495] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:49 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:50.861797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-373271339", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9e5d769-a2db-434e-aa7d-110535a28faa"}], "security_groups": [{"name": "tempest-securitygroup--394796820"}], "key_name": "tempest-keypair-1047912438", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:50.971071 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] validate_networks() for [('a9e5d769-a2db-434e-aa7d-110535a28faa', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:14:51.196437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.197065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.203749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.204475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.206017 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.207198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.415456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.426699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-84ad8a3c-6c28-4d22-8af5-a2d0c5a0e848 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.234004 Jun 07 13:14:51.427389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:14:51.436190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:14:51.436190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:14:51.436190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:14:51.436190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:14:51.437723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 245/496] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:51.438784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.439263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.440347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:51.440887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:51.469708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:14:51.474948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Getting quotas for user 025ca1d10d5e49e984c7fd4e0b425f08 and project f9cf247a413d45049be49368cbce7213. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:14:51.487297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:14:51.489810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:14:51.542704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9757e9fa-ac11-4123-9314-8f3b09f42c1c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.685266 Jun 07 13:14:51.543627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 252/497] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:14:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:14:51.565621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-481b555d-b270-4564-b856-e08e2e994c4d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:51.566283 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-481b555d-b270-4564-b856-e08e2e994c4d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:51.639471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-481b555d-b270-4564-b856-e08e2e994c4d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:51.646562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-481b555d-b270-4564-b856-e08e2e994c4d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1245 microversion: 2.1 time: 0.096730 Jun 07 13:14:51.647337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 246/498] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:51 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:52.444920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.445563 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.452733 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.453229 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.453995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.454432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.598229 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.608409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cfacbb45-ba4e-4f80-a012-34eb0111ffd9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.167407 Jun 07 13:14:52.609604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 253/499] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:52.663877 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:52.665133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:52.672358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.673155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.673957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.674469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.781215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c4cd0c6f-248f-4003-9128-7eb93c8e5dfd req-6b2388b8-9468-4014-89c6-f21d8f88ed12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "name": "network-vif-plugged", "status": "completed", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:52.792004 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:52.794715 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c4cd0c6f-248f-4003-9128-7eb93c8e5dfd req-6b2388b8-9468-4014-89c6-f21d8f88ed12 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:52.795360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c4cd0c6f-248f-4003-9128-7eb93c8e5dfd req-6b2388b8-9468-4014-89c6-f21d8f88ed12 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:52.809798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c4cd0c6f-248f-4003-9128-7eb93c8e5dfd req-6b2388b8-9468-4014-89c6-f21d8f88ed12 service nova] Creating event network-vif-plugged:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:14:52.813207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ffd3ca1c-bc73-4207-9385-673bc1dc442b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1305 microversion: 2.1 time: 0.151387 Jun 07 13:14:52.815970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c4cd0c6f-248f-4003-9128-7eb93c8e5dfd req-6b2388b8-9468-4014-89c6-f21d8f88ed12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048787 Jun 07 13:14:52.817176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 254/501] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:52.824374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 247/500] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:52 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:53.628002 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.629376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.637274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.637720 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.638531 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.638961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.780166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:53.788865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-88ff8bbb-9e19-44d8-a9bc-b7eeccb02c96 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.165903 Jun 07 13:14:53.789518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 255/502] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:53.832014 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:53.833640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:53.845990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.846538 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.847478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:53.848012 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:53.980852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:53.988778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fbb54bc1-2ff1-497b-a869-c014d5f11d11 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.161349 Jun 07 13:14:53.989385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 248/503] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:53 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:54.808409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:54.809008 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:54.821811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.823018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.823947 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:54.824412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:54.995749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.006924 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:55.008720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:55.015996 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.016550 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.016706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6cd43440-52f5-4c39-b517-5754ca2412c0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1259 microversion: 2.1 time: 0.214767 Jun 07 13:14:55.017366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 256/504] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:54 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:55.017733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.018248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.119943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-46bcd103-7512-46d7-bd73-c172e8061bd9 req-af891653-ccd5-4a95-92c3-25a43dc88214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:55.129455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-46bcd103-7512-46d7-bd73-c172e8061bd9 req-af891653-ccd5-4a95-92c3-25a43dc88214 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:55.130196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-46bcd103-7512-46d7-bd73-c172e8061bd9 req-af891653-ccd5-4a95-92c3-25a43dc88214 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:55.153363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-46bcd103-7512-46d7-bd73-c172e8061bd9 req-af891653-ccd5-4a95-92c3-25a43dc88214 service nova] Creating event network-changed:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:14:55.172130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-46bcd103-7512-46d7-bd73-c172e8061bd9 req-af891653-ccd5-4a95-92c3-25a43dc88214 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055482 Jun 07 13:14:55.175221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 257/505] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:55.234639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:55.244351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4e8b96ae-e13e-480b-ad07-baaf82c4256d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.242216 Jun 07 13:14:55.249106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 249/506] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:55 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:14:56.034887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.035480 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.042095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.042537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.043334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.043760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.177253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.184929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f220ae5c-e9ce-48ce-adbd-56971050884a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1444 microversion: 2.1 time: 0.154977 Jun 07 13:14:56.185527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 258/507] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:56.201872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.202440 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.209833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.210273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.211036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.211463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.262383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:56.263027 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:56.269527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.269975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.270745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:56.271179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:56.354067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.362024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-77b712e1-882e-435c-ba5d-de40883c4c97 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1444 microversion: 2.1 time: 0.164050 Jun 07 13:14:56.362705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 250/508] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:56.403674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:56.412164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0bdd826c-19a6-4e2a-80f4-011397fbe26f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.153682 Jun 07 13:14:56.413146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 259/509] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:56 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:57.430256 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:57.430825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:57.437532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.437982 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.438756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:57.439384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:57.574404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:57.582590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-585b90d8-6dbc-4ba0-af7f-4b16d65bad22 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.156244 Jun 07 13:14:57.583246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:57 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:58.505148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-00365ace-fb1c-48e6-a1f4-0a9461b25731 req-9fffdb89-1834-4b2f-b448-12bdfce1d702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:14:58.513285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-00365ace-fb1c-48e6-a1f4-0a9461b25731 req-9fffdb89-1834-4b2f-b448-12bdfce1d702 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.513718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-00365ace-fb1c-48e6-a1f4-0a9461b25731 req-9fffdb89-1834-4b2f-b448-12bdfce1d702 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.525060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-00365ace-fb1c-48e6-a1f4-0a9461b25731 req-9fffdb89-1834-4b2f-b448-12bdfce1d702 service nova] Creating event network-changed:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:14:58.530203 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-00365ace-fb1c-48e6-a1f4-0a9461b25731 req-9fffdb89-1834-4b2f-b448-12bdfce1d702 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029138 Jun 07 13:14:58.530802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 260/511] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:14:58.600315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:58.600967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:58.608119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.608569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.609359 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:58.609794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:58.759064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:58.766676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1b4198b2-c9ba-4437-a399-2bf056040ed7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.170395 Jun 07 13:14:58.767308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 252/512] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:58 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:14:59.784749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:14:59.785474 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:14:59.792318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.792785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.793590 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:14:59.793981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:14:59.934750 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:14:59.943096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5c12cb01-2b25-4465-b570-ee43b054ec25 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.162997 Jun 07 13:14:59.943667 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 261/513] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:14:59 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:00.960000 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:00.960608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:00.967690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.968142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:00.968908 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:00.969387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:01.108385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:01.118043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-96033d63-2719-4413-99cc-e7f5819a4061 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.161906 Jun 07 13:15:01.118620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 253/514] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:00 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:02.137891 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:02.138546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:02.141409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:02.142063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=10 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:02.149695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.150280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.151358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:02.151919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:02.297568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:02.305840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3957e3b-e4a3-4a9f-8953-84a322bd614c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.174221 Jun 07 13:15:02.306428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 262/515] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:02 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:03.323303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:03.323919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:03.325843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:03.332141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.332589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.333391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:03.333825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:03.485975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:03.493869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dc3a0eb5-a0bc-4892-bdde-ee4d0158f8ca tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.174459 Jun 07 13:15:03.494590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 254/516] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:03 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:04.511543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:04.512174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:04.518838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.519283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.520040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:04.520739 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:04.665899 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:04.676470 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-783ac7a7-938b-410b-a24a-18faf40556db tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.168857 Jun 07 13:15:04.677070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 263/517] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:04 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:05.694556 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:05.695374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:05.702179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.702881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.703881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:05.704507 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:05.918549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:05.926635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4bcb857d-de00-42e8-ba22-915cc418eeb4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.236861 Jun 07 13:15:05.927200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 255/518] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:05 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:06.944176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:06.944788 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:06.952446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.952965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.953826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:06.954346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:06.973735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:07.087597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:07.095023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e57d7fb8-5b6c-49d8-a74e-98e84ac06332 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.155112 Jun 07 13:15:07.095628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 264/519] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:06 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:08.111958 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:08.112689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:08.120158 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.120630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.121650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.122119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.259445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:08.266992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-609314be-e8ef-48d2-a957-dd7fbab71429 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.159069 Jun 07 13:15:08.267626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 256/520] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:08 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:08.964441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-5a8f0f98-e067-4a00-b0d7-0c93f8063a3d req-a018ed75-9e3e-43ff-b732-dade9f1f8125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "name": "network-vif-plugged", "status": "completed", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:08.973100 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5a8f0f98-e067-4a00-b0d7-0c93f8063a3d req-a018ed75-9e3e-43ff-b732-dade9f1f8125 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:08.973596 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5a8f0f98-e067-4a00-b0d7-0c93f8063a3d req-a018ed75-9e3e-43ff-b732-dade9f1f8125 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:08.986632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-5a8f0f98-e067-4a00-b0d7-0c93f8063a3d req-a018ed75-9e3e-43ff-b732-dade9f1f8125 service nova] Creating event network-vif-plugged:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:15:08.992661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-5a8f0f98-e067-4a00-b0d7-0c93f8063a3d req-a018ed75-9e3e-43ff-b732-dade9f1f8125 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031845 Jun 07 13:15:08.993688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 265/521] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:09.284832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:09.286358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:09.296653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.297349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.298307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:09.299023 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:09.444600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:09.452828 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-080b90d5-87d4-44c1-aca4-1194836a9a62 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.172014 Jun 07 13:15:09.453430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:09 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:10.471307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:10.472176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:10.480470 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.481317 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.482175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:10.482788 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:10.627393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:10.636175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2bb15550-aa23-4280-b996-ecc018b86ad4 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1370 microversion: 2.1 time: 0.169356 Jun 07 13:15:10.645542 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 266/523] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:10 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:15:11.654525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.655138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.657179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=42 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:11.663072 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.663607 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.664296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.664725 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.799409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:15:11.807160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f1807185-0ea3-4ec4-8bf7-1aff24da622f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1564 microversion: 2.1 time: 0.157428 Jun 07 13:15:11.807929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:15:11.824829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:11.825423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:11.827581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:11.833279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.833728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.834493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:11.834920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:11.915853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-23c6fbb5-5444-4a0f-a689-579716806ea9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095160 Jun 07 13:15:11.916448 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:15:11 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:15:12.886076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-786fd451-ebdb-4e83-8f5a-485510c350e5 req-f84598ca-8c5d-4fd6-a6c8-a59c452bd0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:15:12.894659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-786fd451-ebdb-4e83-8f5a-485510c350e5 req-f84598ca-8c5d-4fd6-a6c8-a59c452bd0bf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:12.895342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-786fd451-ebdb-4e83-8f5a-485510c350e5 req-f84598ca-8c5d-4fd6-a6c8-a59c452bd0bf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:12.906512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-786fd451-ebdb-4e83-8f5a-485510c350e5 req-f84598ca-8c5d-4fd6-a6c8-a59c452bd0bf service nova] Creating event network-changed:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:15:12.913749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-786fd451-ebdb-4e83-8f5a-485510c350e5 req-f84598ca-8c5d-4fd6-a6c8-a59c452bd0bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031202 Jun 07 13:15:12.914353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 259/526] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:15:14.086419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:15:14.087043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Tue Jun 7 13:15:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:15:21.994065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:15:21.994716 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Tue Jun 7 13:15:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:15:57.625674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:15:57.626273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:15:57.628588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:57.629155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=14 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:15:57.635235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.635463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.636214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:15:57.636962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:15:57.663696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dfaa0849-4566-4870-a1c4-51dfc99f6464 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/ips" status: 200 len: 149 microversion: 2.20 time: 0.041976 Jun 07 13:15:57.664459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 268/527] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jun 7 13:15:57 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:16:00.092414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:00.094903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=85 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:00.102033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:00.103262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:00.117372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.118396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.119294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.119847 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.150269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lazy-loading 'flavor' on Instance uuid 4f0a617c-95aa-46f2-8159-056830649054 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:16:00.447680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4f7e9fb9-e71a-4646-b5dd-942f769ffa1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/action" status: 202 len: 0 microversion: 2.20 time: 0.357750 Jun 07 13:16:00.448742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 260/528] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jun 7 13:16:00 2022] POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:16:00.457053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:00.458269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:00.465579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.466204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.467635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:00.468275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:00.642986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:00.652375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:00.654324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:00.655953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-affbb83a-9a54-4d44-8ae0-b5ef44c97b93 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.202938 Jun 07 13:16:00.656519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 269/529] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:00 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:01.676203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:01.677575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:01.684083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:01.684536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.686012 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:01.686447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:01.902528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:01.911124 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:01.912966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:01.914275 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-316d1cfe-0f74-41d7-b39b-1db151de434f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.243121 Jun 07 13:16:01.915078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 261/530] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:01 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:02.942603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:02.944874 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:02.954045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.954490 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:02.955506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:02.955937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:03.171384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:03.184827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:03.186601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:03.188073 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a60585e5-1fe3-48ab-a3e3-3c3c2816b8e2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.258507 Jun 07 13:16:03.190108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 270/531] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:02 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:04.207368 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:04.208611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:04.221764 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.222552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.224866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:04.225540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:04.637567 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:04.659984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:04.663301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:04.665769 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2557daa2-8d84-4e92-a0e8-eec79eb17585 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.461875 Jun 07 13:16:04.667843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 262/532] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:04 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:05.495955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cdf2cc4a-86c0-42d5-b7f5-d83d0b73d53b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Action: 'create', calling method: .version_select at 0x7f20a48cb3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-624960488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyUqkIjLnir5RgebfUpOoCY/j2r0Mh3d8PPzE9w2j+oEO7FjvJcsRE10JhyRxI+BKmaql9GxmVZBwpXG+He0CJsqaAq/8vTLnwJ/+tH+i3INGaO6TAa58dEwC7jjm9h3A=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:05.510668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-cdf2cc4a-86c0-42d5-b7f5-d83d0b73d53b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for project 03491cee113744268fc89b63330c21c2. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:16:05.515443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-cdf2cc4a-86c0-42d5-b7f5-d83d0b73d53b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for user 43f9e7923ebb4939ac2bd590270b48d7 and project 03491cee113744268fc89b63330c21c2. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:16:05.540299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cdf2cc4a-86c0-42d5-b7f5-d83d0b73d53b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.254205 Jun 07 13:16:05.545667 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 271/533] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:16:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:05.687102 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:05.687718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:05.694913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.695385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.696198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:05.696630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:05.842107 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:05.851224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:05.852987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:05.854193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-490372e8-9875-4d0f-b106-45e9d46a6494 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.171356 Jun 07 13:16:05.855008 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 263/534] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:05 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:16:06.878014 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:06.878728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:06.886243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.887461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:06.888607 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:06.889270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:07.049322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:07.057309 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:07.058792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:07.059937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2dcb31d6-8d46-4abc-95b3-01218888e820 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.189492 Jun 07 13:16:07.060488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 272/535] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:06 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:08.079694 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:08.080286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:08.087258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:08.087707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:08.088580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:08.088972 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:08.227765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:08.236756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:08.238302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:08.239477 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0e0864e3-fdce-4820-b123-682099bf2314 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.163726 Jun 07 13:16:08.240034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 264/536] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:08 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:09.263710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.264347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:09.274345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.274795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.275614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.276049 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.407709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:09.415853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:09.417380 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:09.418536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-59054e7b-50ea-4cc4-8efc-cb82097d20f1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.164297 Jun 07 13:16:09.419103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 273/537] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:09.679296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:09.679971 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:09.686982 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.687429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.688185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:09.688614 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:09.714800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cf56a5cd-3db2-420f-8e13-27ba81b8bc66 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/ips" status: 200 len: 145 microversion: 2.1 time: 0.039389 Jun 07 13:16:09.715347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 265/538] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:16:09 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:10.436588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:10.437204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:10.443731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.444180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.444953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:10.445428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:10.591242 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:10.600682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:10.602936 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:10.604669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-45f59d91-fdf1-40b3-892d-2633bd379633 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.172159 Jun 07 13:16:10.605532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 274/539] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:10 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:11.627192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:11.627805 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:11.635086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.635536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:11.636314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:11.636747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.043332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:12.055637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:12.057980 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:12.059662 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-12af8767-eaa2-46bf-ae2f-7468a4fbb004 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.436257 Jun 07 13:16:12.060490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 266/540] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:11 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:12.926955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "152852cf-0742-44bb-b45f-9bd98c183de3"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:12.928019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:12.934175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.934614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:12.935369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:12.935793 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.082314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:13.082919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:13.090590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.091088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.091867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:13.092345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:13.227217 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:13.235722 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:13.237392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:13.238596 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6ec52dbc-aff3-4022-bc21-c6e1a7a35bc6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.160466 Jun 07 13:16:13.239160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 267/541] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:13.243857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cddc87ca-b1d8-4b1c-aaf7-e2366ec7a69a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321011 Jun 07 13:16:13.245094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 275/542] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:16:12 2022] POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:14.261886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:14.262511 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:14.272783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:14.272783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:14.272783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:14.273309 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:14.427268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:14.436333 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:14.437778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:14.438944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff597128-d8c0-44d0-9c6f-af3fa2aa0969 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.182280 Jun 07 13:16:14.439815 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 268/543] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:14 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:15.458294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:15.458932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:15.466909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:15.467360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:15.468140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:15.468568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:15.522672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:15.607232 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:15.623207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:15.625192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:15.626454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-894eff58-1e01-4826-b0ab-f93ba0a96fea tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.173044 Jun 07 13:16:15.627128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 276/544] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:15 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:16.645864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:16.646439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:16.653708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.654154 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.654926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:16.655358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:16.792119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:16.800427 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:16.801950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:16.803149 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3c661387-68cd-455c-816a-ddbd869ed3c8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.161272 Jun 07 13:16:16.803759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 269/545] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:16 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:17.258346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-2157f323-ad86-48d8-a781-c9437b7c7f86 req-a8f848b9-c3e8-4c52-bac0-23553c20e534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "name": "network-vif-plugged", "status": "completed", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:17.269972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2157f323-ad86-48d8-a781-c9437b7c7f86 req-a8f848b9-c3e8-4c52-bac0-23553c20e534 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.270404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-2157f323-ad86-48d8-a781-c9437b7c7f86 req-a8f848b9-c3e8-4c52-bac0-23553c20e534 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.283982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-2157f323-ad86-48d8-a781-c9437b7c7f86 req-a8f848b9-c3e8-4c52-bac0-23553c20e534 service nova] Creating event network-vif-plugged:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:16:17.289177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-2157f323-ad86-48d8-a781-c9437b7c7f86 req-a8f848b9-c3e8-4c52-bac0-23553c20e534 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036986 Jun 07 13:16:17.289840 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 277/546] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:17.826179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:17.826891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:17.834893 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.835418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.836316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:17.836827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:17.977569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:17.986517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:17.988051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:17.989273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00efc928-f8ee-4944-a0cb-f1e5eff47093 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.169033 Jun 07 13:16:17.989822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 270/547] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:17 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:19.008847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:19.009566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:19.016381 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.016828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.017876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:19.018307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:19.152975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:19.166428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:19.168775 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:19.170729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f50201c-5f0e-458e-af62-dc634a76c8ee tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1742 microversion: 2.20 time: 0.166296 Jun 07 13:16:19.171383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 278/548] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:19 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:20.199316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:20.200250 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:20.211111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:20.211974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:20.213282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:20.213979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:20.360146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:20.369183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:20.370786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:20.372342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-27d2f658-75fd-4283-8449-7d50dd1907fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.179453 Jun 07 13:16:20.372890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 271/549] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:20 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:21.393559 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:21.395304 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:21.403066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.404066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.405416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.406624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.556728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:21.566162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:21.567690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:21.568977 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f3a36d0-cca7-4333-a57f-5114e7a03676 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.180374 Jun 07 13:16:21.579929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 279/550] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:21 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:21.907819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-46751600-982d-4d1b-8625-1d959e119d95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:21.915061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46751600-982d-4d1b-8625-1d959e119d95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:21.915648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-46751600-982d-4d1b-8625-1d959e119d95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:21.979199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-46751600-982d-4d1b-8625-1d959e119d95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Going to try to stop instance {{(pid=117833) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:16:22.028936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-46751600-982d-4d1b-8625-1d959e119d95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action" status: 202 len: 0 microversion: 2.1 time: 0.125335 Jun 07 13:16:22.039646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:22.040552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:22.045100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 272/551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:16:21 2022] POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:16:22.048004 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.048779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.050031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.050704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.211274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.220319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-32e1ea58-81fe-4585-a64f-5f40931c56a4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.185701 Jun 07 13:16:22.221182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 280/552] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:22 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:22.588243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:22.588933 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:22.596068 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.596508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.597316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:22.597753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:22.749447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.753869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:22.760684 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.762582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:22.763739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-abf7c3ef-9691-4d45-8913-4501864fa9bb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.179843 Jun 07 13:16:22.764280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 273/553] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:22 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:23.239106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:23.239685 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:23.248723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.249341 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.250431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.250851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.443195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.453690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e20e9fd5-cb34-4563-b032-e290517684d5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.218055 Jun 07 13:16:23.455821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 281/554] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:23 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:23.782837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:23.783480 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:23.792231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.792760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.793806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:23.794392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:23.938123 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.948200 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.949750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:23.950919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aa72c5ee-6754-460a-af49-7717b50721d6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.172216 Jun 07 13:16:23.951483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 274/555] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:23 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:24.473263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:24.473894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:24.480521 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.480959 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.481751 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.482175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.624812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:24.633298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bd9afe4f-b794-4a28-b098-9e981532713b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.165277 Jun 07 13:16:24.634172 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 282/556] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:24 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:24.972932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:24.973576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:24.980301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.980747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:24.981570 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:24.982009 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.156542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:25.167352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:25.169331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:25.170842 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8e951966-8593-4bc9-97cb-704ce1fef0d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.203771 Jun 07 13:16:25.171532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 275/557] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:24 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:25.657183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:25.658538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:25.665723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.666437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.667444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:25.667906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:25.810271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:25.819215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fc498143-dcb3-476d-ae82-646fe3160fca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.166223 Jun 07 13:16:25.820081 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 283/558] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:25 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:26.191162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:26.192549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:26.199058 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.199498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:26.200482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.200944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:26.338571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:26.346781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:26.348418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:26.349546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-63ecd4a9-aaf6-4df4-89a5-2360fef87901 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.163399 Jun 07 13:16:26.350105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 276/559] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:26 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:26.837383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:26.837981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:26.844884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.845344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:26.846155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:26.846586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.003901 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.013119 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07991c92-9a14-4185-85c2-73b958d90b40 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.179853 Jun 07 13:16:27.018818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 284/560] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:26 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:27.372219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:27.372828 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:27.380469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.380963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.381809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:27.382243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:27.522711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.530917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.532417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:27.533715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1a0478a3-5161-4376-add3-59beff6ef2b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.166536 Jun 07 13:16:27.534328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 277/561] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:27 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:28.034445 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:28.036139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:28.041454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:28.043779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.044324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.045343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.045974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.054054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:28.212515 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:28.222580 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c4aae171-b2ef-4dec-a83f-98bb9549ca74 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.194775 Jun 07 13:16:28.223157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 285/562] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:28 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:28.551776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:28.552559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:28.559388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.559833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.560607 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:28.561058 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:28.698038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:28.706739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:28.708333 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:28.709524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4bcb89a9-fc85-4e96-b721-fb4be20510b6 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.161639 Jun 07 13:16:28.710057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 278/563] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:28 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:29.240366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:29.240981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:29.247795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.248227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.248990 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.249440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.402259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.411831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8ee85f36-fbba-4b6f-b3da-fc70d788ccfb tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.175332 Jun 07 13:16:29.415197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 286/564] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:29 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:29.733788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:29.734345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:29.741134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.741576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.742325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:29.742756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:29.892532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.900779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.902240 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:29.903378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3accc13e-6182-41b5-a2ac-103b61a9ba3a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.173732 Jun 07 13:16:29.904106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 279/565] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:29 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:30.433393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:30.433986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:30.442294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.443088 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.444190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.444669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.601694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:30.615829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b7e8cc67-f787-4fa2-81ce-7d79a35b2eef tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.187976 Jun 07 13:16:30.616817 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 287/566] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:30 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:30.921836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:30.922532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:30.924937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=41 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:30.930702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.931152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:30.931931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:30.932373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:31.068783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:31.077407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:31.078896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:31.080151 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d99710dd-64c8-4187-ae45-8102d0bc19a3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.162314 Jun 07 13:16:31.080882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 280/567] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:30 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:31.374666 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-415387474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624960488", "security_groups": [{"name": "tempest-secgroup-smoke-813133215"}], "block_device_mapping_v2": [{"uuid": "caaf9227-f850-4194-b6a8-8c9f173f8b00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d3913f7-d82f-4020-8fba-805cb52d0d5c"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:31.495547 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] validate_networks() for [('8d3913f7-d82f-4020-8fba-805cb52d0d5c', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:16:31.633715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:31.634321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:31.640659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:31.641130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:31.641904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:31.642348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:31.798373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:31.808266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8bcf7331-30db-4666-a44d-5ee43495fa0a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.178275 Jun 07 13:16:31.817103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 281/568] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:31 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:32.099134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:32.099907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:32.107327 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.108146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.109210 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.109743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.148987 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:16:32.149648 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:16:32.150118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:16:32.150749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:16:32.151421 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:16:32.169878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.170432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.171329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.171837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.200844 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:16:32.205400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for user 43f9e7923ebb4939ac2bd590270b48d7 and project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:16:32.264992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.269083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:16:32.271621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='caaf9227-f850-4194-b6a8-8c9f173f8b00',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:16:32.273884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.275426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.276888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6c8d978-f8dc-4efb-ad0e-ba9eeea5d020 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.181581 Jun 07 13:16:32.288016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 282/569] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:32 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:32.439185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-391eebe8-d063-4033-a0e4-53efe22a37c1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.069147 Jun 07 13:16:32.445152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 288/570] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:16:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:16:32.450460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81de55d2-482f-423b-b83f-314efc1f9c23 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:32.451043 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81de55d2-482f-423b-b83f-314efc1f9c23 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:32.516018 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81de55d2-482f-423b-b83f-314efc1f9c23 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:32.523903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81de55d2-482f-423b-b83f-314efc1f9c23 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1093 microversion: 2.1 time: 0.077367 Jun 07 13:16:32.533313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 283/571] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:32 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:32.835106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:32.835705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:32.845802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.846266 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:32.847113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:32.847529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.001111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.012368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7da880b6-6755-4460-967e-61439dcea583 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.182074 Jun 07 13:16:33.013307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 289/572] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:32 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:33.295818 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:33.296402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:33.306439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.307183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.307999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.308395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.453954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.465603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.467404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.468818 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c7c1dde-56bc-437d-9dd3-2f5c9249ff2b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.177361 Jun 07 13:16:33.469433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 284/573] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:33 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:33.540756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:33.541892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:33.554972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.555491 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.556343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:33.556806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:33.645467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:33.660564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b71b3212-04ae-4ce0-a7e1-94075e2ee0c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1199 microversion: 2.1 time: 0.123475 Jun 07 13:16:33.661362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 290/574] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:33 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:34.030777 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:34.031402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:34.038140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.038596 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.039462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.039905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.257979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.267208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a5759e96-47d2-4603-a714-bb99c389c505 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.240175 Jun 07 13:16:34.267863 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 285/575] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:34 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:34.488837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:34.490162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:34.498172 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.498626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.499457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.499809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.682311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:34.682936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:34.686858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.693692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.694231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.695014 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:34.695443 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:34.695813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.697702 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.699015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60a0b95b-a8bd-4f7a-bd40-acac2b9dfb9a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1737 microversion: 2.20 time: 0.215245 Jun 07 13:16:34.699638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 291/576] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:34 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:34.926300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:34.934480 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-92ea4edc-b3e4-49d4-b1b9-a96aac6e06f3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1276 microversion: 2.1 time: 0.258788 Jun 07 13:16:34.935057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 286/577] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:34 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:16:35.286319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:35.287424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:35.312832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.313507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.314452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.320987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-35f53b7a-752e-44da-bcb9-6684aa2db29c req-5cf65b12-8afe-4232-95b9-76ec00e207b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f08c6a-dd16-4928-a462-8c396f9608a6", "tag": "b2917f80-dcb9-4be9-8700-b022a43d153c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:35.326537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.337424 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-35f53b7a-752e-44da-bcb9-6684aa2db29c req-5cf65b12-8afe-4232-95b9-76ec00e207b4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.352451 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-35f53b7a-752e-44da-bcb9-6684aa2db29c req-5cf65b12-8afe-4232-95b9-76ec00e207b4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.367767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-35f53b7a-752e-44da-bcb9-6684aa2db29c req-5cf65b12-8afe-4232-95b9-76ec00e207b4 service nova] Creating event network-changed:b2917f80-dcb9-4be9-8700-b022a43d153c for instance a6f08c6a-dd16-4928-a462-8c396f9608a6 on hv-cinder-84496 Jun 07 13:16:35.383905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-35f53b7a-752e-44da-bcb9-6684aa2db29c req-5cf65b12-8afe-4232-95b9-76ec00e207b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062284 Jun 07 13:16:35.384954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 287/578] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:16:35.500227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:35.508786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8916ccda-6f0d-4f7c-85c3-8f90f5e0bba0 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.226553 Jun 07 13:16:35.509398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 292/579] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:35 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:35.722015 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:35.723081 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:35.730257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.730708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.731476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.731909 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.868841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:35.880880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:35.882371 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:35.883523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-817599b7-4720-4b1b-922b-7f7586e61854 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1719 microversion: 2.20 time: 0.168973 Jun 07 13:16:35.884079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 288/580] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:35 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:35.955571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:35.956743 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:35.967012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.967747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:35.968993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:35.969748 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.107639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:36.115589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cf0cb548-1359-42b0-b661-45c2e4baa71b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.166510 Jun 07 13:16:36.116194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 293/581] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:35 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:36.526710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:36.527390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:36.534785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.535286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.536171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.537196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.685540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:36.696793 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1ffe3432-2ceb-435f-b0f2-b24fafe2e1a5 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1724 microversion: 2.1 time: 0.174487 Jun 07 13:16:36.697406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 289/582] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:36 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:36.902540 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:36.903120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:36.910002 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.910440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:36.911578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:36.912021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.060365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.070271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.071970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.073197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c6613db-2bd1-4728-8e9d-736da046ff6e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1719 microversion: 2.20 time: 0.174637 Jun 07 13:16:37.074042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 294/583] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:36 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:37.132890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:37.133526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:37.140391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.140864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.141654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.142070 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.324221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.331948 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6f73cf9c-2b46-4a7f-a123-bf690684381b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.202997 Jun 07 13:16:37.332503 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 290/584] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:37 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:37.717538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:37.718443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:37.729581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.730283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.731476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.732123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.864415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:37.873499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a4bdb6d0-c1eb-4b70-88f8-f088cb8dfbc8 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1701 microversion: 2.1 time: 0.162306 Jun 07 13:16:37.874050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 295/585] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:37 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:37.890575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6a3d0c3-a25a-4995-82d6-413613732561 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:37.896927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a3d0c3-a25a-4995-82d6-413613732561 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.897391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a3d0c3-a25a-4995-82d6-413613732561 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.920312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b6a3d0c3-a25a-4995-82d6-413613732561 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Going to try to start instance {{(pid=117833) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:16:37.938624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:37.967683 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6a3d0c3-a25a-4995-82d6-413613732561 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action" status: 202 len: 0 microversion: 2.1 time: 0.080869 Jun 07 13:16:37.968279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 291/586] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:16:37 2022] POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:16:37.976819 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:37.977456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:37.984079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.984516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:37.985315 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:37.985754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.092761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:38.093476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.100504 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.100943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.101749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.102186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.122209 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.130958 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-207ca3ab-9144-4122-afe5-0d7909043029 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1710 microversion: 2.1 time: 0.158177 Jun 07 13:16:38.131541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 296/587] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:37 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:38.242611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.255193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.256789 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.257975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ede20726-c941-4e45-8e3a-f29cd91e2cd0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1662 microversion: 2.20 time: 0.169968 Jun 07 13:16:38.258544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 292/588] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:38 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:38.284717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42b51fe7-f011-4c2c-abfe-633f1a0f5976"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:38.286326 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.292931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.293423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.294190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.294627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.349157 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:38.349904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.355998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.356445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.357245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.357668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.510196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:38.520658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aed449cc-faf9-47e3-8bf7-6c67d802de7d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.175050 Jun 07 13:16:38.522343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 293/589] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:38 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:38.605665 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-196a7da8-ab34-420c-9716-47b779b085b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326695 Jun 07 13:16:38.608386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 297/590] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jun 7 13:16:38 2022] POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:16:38.738974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:38.739688 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.747650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.748134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.749198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.750282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.852369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-75c45a34-0308-4b2d-bd2f-50c8a81c73e4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/action" status: 202 len: 0 microversion: 2.20 time: 0.117399 Jun 07 13:16:38.855346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 294/591] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jun 7 13:16:38 2022] POST /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:16:38.861131 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:38.861838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:38.872086 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.872660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:38.873634 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:38.874225 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.073038 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.082756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.084519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.085876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5042aea3-712d-4a2a-b01a-8b78e1b6200f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1748 microversion: 2.20 time: 0.228729 Jun 07 13:16:39.086432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 298/592] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:38 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1748 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:39.148086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:39.148565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:39.154855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.155293 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.156061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.156590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.305849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.315298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9e235a6d-5a72-4d83-8209-abcdc09a0457 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1710 microversion: 2.1 time: 0.171347 Jun 07 13:16:39.317199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 295/593] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:39 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:39.466447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-925ecb3e-0c84-4a3f-b858-fc1c53b3866b req-345e5c5f-4001-4c3a-bd91-4941b5ff63c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "name": "network-vif-unplugged", "status": "completed", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:39.475303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-925ecb3e-0c84-4a3f-b858-fc1c53b3866b req-345e5c5f-4001-4c3a-bd91-4941b5ff63c9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.476134 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-925ecb3e-0c84-4a3f-b858-fc1c53b3866b req-345e5c5f-4001-4c3a-bd91-4941b5ff63c9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.493973 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.compute.server_external_events [req-925ecb3e-0c84-4a3f-b858-fc1c53b3866b req-345e5c5f-4001-4c3a-bd91-4941b5ff63c9 service nova] Unable to find a host for instance 4f0a617c-95aa-46f2-8159-056830649054. Dropping event network-vif-unplugged {{(pid=117832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:16:39.494961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-925ecb3e-0c84-4a3f-b858-fc1c53b3866b req-345e5c5f-4001-4c3a-bd91-4941b5ff63c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032882 Jun 07 13:16:39.495777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 299/594] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:16:39.539388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:39.539998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:39.549128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.549757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.550522 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:39.550957 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:39.683965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:39.691441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-87a91855-024c-4bba-a069-81519b6e71aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.156133 Jun 07 13:16:39.692040 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 296/595] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:39 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:40.108814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:40.109715 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:40.118367 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.118811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.119578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.120005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.135049 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:40.263551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.277718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.280181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.282137 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f7562bfc-d2f1-4096-a53d-1ca995c2ed02 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1748 microversion: 2.20 time: 0.179539 Jun 07 13:16:40.283052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 300/596] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:40 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1748 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:40.333664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:40.334215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:40.341914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.342377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.343499 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.344132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.502299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.512630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9a873e1e-be9d-4fab-aa26-d0fc48a52892 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1714 microversion: 2.1 time: 0.183173 Jun 07 13:16:40.513153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 297/597] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:40 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1714 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:40.710825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:40.711434 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:40.717860 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.718314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.719085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:40.719529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:40.851258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:40.859379 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c230e6c7-2908-42e3-8008-08f5c019042c tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.153431 Jun 07 13:16:40.859960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 301/598] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:40 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:41.306623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:41.307226 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:41.313844 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.314284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.315075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.315506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.451566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:41.461213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:41.462826 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:41.463982 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-947123cb-bd21-40ad-8a44-90103e531022 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1750 microversion: 2.20 time: 0.162390 Jun 07 13:16:41.464546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 298/599] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:41 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:41.877180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:41.877778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:41.884633 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.885138 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:41.885909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:41.886352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:42.111864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:42.120491 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4561eb65-0e1e-4821-bfd7-37ce51babaf3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.247313 Jun 07 13:16:42.125789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 302/600] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:41 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:42.483885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:42.484527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:42.491605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:42.492154 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:42.493033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:42.493567 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:42.524365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:42.629763 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:42.638668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:42.640164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:42.641372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0b84955a-a62d-4425-a102-4a4d2dd454ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.161532 Jun 07 13:16:42.641930 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 299/601] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:42 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:43.145700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:43.147195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:43.155577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:43.156246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:43.158343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.158795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.159576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.160208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.315615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.323553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-91cf82f3-3717-4045-8451-8a315f222941 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.183848 Jun 07 13:16:43.324138 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 303/602] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:43 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:43.659824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:43.660489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:43.667733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.668193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.668995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:43.669467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:43.840484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.854301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.856782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:43.858715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-01767807-5905-4d1b-ae7a-da8440b4ffdb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.202651 Jun 07 13:16:43.859649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 300/603] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:43 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:44.340328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:44.340897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:44.347982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.348429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.349242 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.349683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.502280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:44.513401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cb16a3a9-9d7f-4123-adea-901c1898062f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.177145 Jun 07 13:16:44.514185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 304/604] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:44 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:44.877646 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:44.878392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:44.885281 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.885723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:44.886483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:44.886909 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.025901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.034484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.035956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.037145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-680b1c0f-50b2-4f40-995c-c3a7eaf3a6cd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.163530 Jun 07 13:16:45.037703 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 301/605] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:44 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:45.534031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:45.534669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:45.544087 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.544680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.545567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:45.546022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:45.685207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:45.694225 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ba4f080f-225e-43f6-bdf3-f3c8b1224360 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.166969 Jun 07 13:16:45.703451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 305/606] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:45 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:46.055921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:46.056603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:46.063045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.063623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.064419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.064939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.240634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:46.249556 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:46.251047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:46.252201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-964a7f08-3724-44fb-8319-c29a07571846 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.200251 Jun 07 13:16:46.252759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 302/607] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:46 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:46.717865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:46.718490 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:46.725272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.725970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.726922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:46.727860 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:46.927579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:46.935336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c02e099b-f9d2-450d-a84b-276927d35ba1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.221550 Jun 07 13:16:46.935893 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 306/608] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:46 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:47.270921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:47.272713 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:47.280287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.281141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.282584 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.283243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.419824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:47.430452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:47.431945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:47.433294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d22a0a62-3659-4c19-9297-0a14e69a0660 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.166410 Jun 07 13:16:47.433907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 303/609] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:47 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:47.952333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:47.952927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:47.959724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.960162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:47.960910 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:47.961395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.110767 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:48.118307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e1df569-14e2-4edc-b964-8afb37feecf0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.170121 Jun 07 13:16:48.118872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 307/610] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:47 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:48.452608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:48.453268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:48.460247 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.460689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.461508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:48.461921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:48.668456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:48.676975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:48.678479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:48.679630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1fa72eb1-c72f-4b9b-b132-370ec8c82440 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.231587 Jun 07 13:16:48.680192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 304/611] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:48 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:49.137998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:49.138600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:49.145482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.145964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.146734 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.147174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.288332 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.296357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-291d0dda-bd34-4f36-94f9-0dc7a5a424fe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.164133 Jun 07 13:16:49.296921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 308/612] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:49 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:49.698337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:49.699093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:49.706073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.706521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.707293 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:49.707726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:49.851997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.860653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.862223 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:49.863349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0d979c59-b5ea-44f2-9063-f5f95244befa tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.169217 Jun 07 13:16:49.863892 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 305/613] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:49 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:50.317409 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:50.317999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.324551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.324994 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.325866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.326298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.484390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:50.495551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-adf0dde4-1913-428b-8ce4-a3fd7beb1a0d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.182073 Jun 07 13:16:50.496532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 309/614] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:50 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:50.883768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:50.884360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:50.892187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.892633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:50.893435 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:50.893870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:51.028273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:51.031886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:51.038509 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:51.040073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:51.041362 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-578b45f6-cd53-4bb6-99ec-f63b0633390f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.162789 Jun 07 13:16:51.041934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 306/615] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:50 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:51.513968 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:51.514554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:51.521804 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:51.522362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:51.523187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:51.523612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:51.676632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:51.684971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-82d5d27f-c4f1-4b84-a687-f5009991beb5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.174860 Jun 07 13:16:51.685682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 310/616] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:51 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:52.061054 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:52.061627 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:52.069035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.069496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.070262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.070692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.210563 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.220841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.222872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.224300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a467053-e20d-4fd7-9dbf-11cc244aaf04 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.168319 Jun 07 13:16:52.224873 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 307/617] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:52 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:52.704894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:52.706244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:52.713695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.714168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.714963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:52.715425 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:52.854922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:52.862998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70c3531e-fa13-4c6f-8ccc-59b45e731607 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.163789 Jun 07 13:16:52.863550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 311/618] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:52 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:53.247773 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:53.248721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:53.256193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.256645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.257445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.257874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.393074 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.405941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.407437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:53.408588 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b885f340-744f-4bdd-8011-e56368b980a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.167796 Jun 07 13:16:53.409173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 308/619] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:53 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:53.884518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:53.885449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:53.896775 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.897625 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:53.898908 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:53.899630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:54.038880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:54.050475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2a1c3f72-ba1c-4287-af01-5e94cb2e3abe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.172240 Jun 07 13:16:54.051337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 312/620] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:53 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:54.433497 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:54.434093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:54.441271 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:54.441719 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:54.442468 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:54.442900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:54.584486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:54.594765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:54.596265 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:54.597462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d0d782a-97e9-4d70-aeb7-a18a2babc231 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.167871 Jun 07 13:16:54.598187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 309/621] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:54 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:55.068818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:55.069520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:55.077329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.077907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.078818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.079260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.162267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dd37fb9-06eb-4399-a958-7ff555a24786"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:16:55.163407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:55.169940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.170377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.171179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.171743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.213869 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:55.222710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-77ac296d-795a-402b-9196-22e6a6cf45ad tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.158121 Jun 07 13:16:55.223624 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 313/622] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:55 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:55.620478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:55.621798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:55.628972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.629615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.630417 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:55.630845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:55.762175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:55.771298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:55.772824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:55.774009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-70f3a39c-f832-4094-8b99-6ad9af669005 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.159207 Jun 07 13:16:55.774571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 314/623] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:55 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:16:56.240532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:56.241381 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:56.249039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.249661 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:56.250498 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.250946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:56.395749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:56.403580 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-283ca7f3-6e42-4222-ac8e-6e7b5540c0e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.167126 Jun 07 13:16:56.404155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 315/624] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:56 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:56.804261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:56.805269 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:56.816461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.816461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:56.817756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:56.818350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:56.961493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:56.970629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:56.972120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:56.973321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-33993099-1b6c-44af-81cc-5ae3aca19c0f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.175695 Jun 07 13:16:56.973877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 316/625] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:56 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:57.423446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:57.424101 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:57.430893 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:57.431328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:57.432091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:57.432520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:57.435114 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:57.578283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:57.586264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e5bce722-4d95-4d2d-a262-627aa5fafa92 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.168114 Jun 07 13:16:57.586831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 317/626] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:57 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:57.993217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:57.993922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:58.001826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:58.002349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:58.003251 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:58.003746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:58.173842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:58.182938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:58.184443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:58.185647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-50132413-fbb7-4a43-8785-3ace2a3668d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.197177 Jun 07 13:16:58.196610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 318/627] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:57 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:58.251283 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5b291346-8bed-4dc6-82d3-a139a36e006b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.092838 Jun 07 13:16:58.252574 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 310/628] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:16:55 2022] POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments => generated 194 bytes in 3095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:16:58.604110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:58.604723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:58.607843 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:16:58.613622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:58.614072 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:58.614858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:58.615302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:58.776958 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:58.789729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1931c903-b85f-4ed7-859b-fbd684c7dd95 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.189227 Jun 07 13:16:58.790857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 319/629] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:58 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:16:59.204841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:59.205448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:59.214826 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:59.215290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:59.216067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:59.216492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:59.352066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:59.362171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:59.363963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:59.365179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-78d9646a-ed3f-4c86-b32c-701be0f83823 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.165048 Jun 07 13:16:59.365742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 311/630] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:16:59 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:16:59.811349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:16:59.812052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:16:59.822797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:59.823239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:59.824008 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:16:59.824471 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:16:59.960497 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:16:59.968312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99dd7823-e8ef-4fb8-a3be-79967b169cbe tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.161962 Jun 07 13:16:59.968999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 320/631] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:16:59 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:00.384441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:00.385222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:00.392958 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.393467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:00.394241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.394674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:00.542152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:00.551454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:00.552944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:00.554159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-067c673b-b694-4ba2-a013-ee4cde8fa2ff tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.174120 Jun 07 13:17:00.554731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 312/632] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:00 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:00.987319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:00.988035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:00.997154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.997712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:00.998665 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:00.999211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:01.141481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:01.149441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-20159e23-f2e4-4e88-a88e-9226408176c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.167008 Jun 07 13:17:01.150023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:00 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:01.413039 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3a53985a-f054-4695-a455-ec5e0d597f13 req-01f43af9-1c6d-4fb2-b0f4-bb1dc509e27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f08c6a-dd16-4928-a462-8c396f9608a6", "name": "network-vif-plugged", "status": "completed", "tag": "b2917f80-dcb9-4be9-8700-b022a43d153c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:01.418025 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=70 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:01.429338 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3a53985a-f054-4695-a455-ec5e0d597f13 req-01f43af9-1c6d-4fb2-b0f4-bb1dc509e27d service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:01.430083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3a53985a-f054-4695-a455-ec5e0d597f13 req-01f43af9-1c6d-4fb2-b0f4-bb1dc509e27d service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:01.444231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3a53985a-f054-4695-a455-ec5e0d597f13 req-01f43af9-1c6d-4fb2-b0f4-bb1dc509e27d service nova] Creating event network-vif-plugged:b2917f80-dcb9-4be9-8700-b022a43d153c for instance a6f08c6a-dd16-4928-a462-8c396f9608a6 on hv-cinder-84496 Jun 07 13:17:01.449464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3a53985a-f054-4695-a455-ec5e0d597f13 req-01f43af9-1c6d-4fb2-b0f4-bb1dc509e27d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040362 Jun 07 13:17:01.450064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 313/634] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:01.699425 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:01.700020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:01.706363 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:01.706809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:01.707579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:01.708019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:02.121364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:02.130297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:02.131804 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:02.132971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e33a3f6-186a-4c7c-9635-b692c3650e7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.564176 Jun 07 13:17:02.133566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 322/635] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:01 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:02.167795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:02.168492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:02.175669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:02.176119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:02.176884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:02.177358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:02.330475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:02.338136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0fae4191-dcac-4e4c-b296-68ffb804b3ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.174554 Jun 07 13:17:02.338712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 314/636] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:02 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:03.156399 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:03.157452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:03.166307 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.166754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.167514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.167942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.304090 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:03.317820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:03.320163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:03.322018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9ac4d9fa-57bf-4e20-9ad9-a9ef222005d7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.171868 Jun 07 13:17:03.322824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 323/637] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:03 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:03.355608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:03.356245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:03.363527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.363976 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.364744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:03.365217 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:03.496922 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:03.504739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c882b34a-1156-4f5d-ad43-a60fb339e186 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.152998 Jun 07 13:17:03.505341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 315/638] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:03 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:04.344804 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:04.345802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:04.353105 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:04.353562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:04.354328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:04.354763 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:04.499679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:04.508377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:04.509919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:04.511084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa37d60f-e3a9-401b-ab3c-d7bcfee9209c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.173033 Jun 07 13:17:04.511654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 324/639] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:04 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:04.521788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:04.522383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:04.529197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:04.529652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:04.530421 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:04.530859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:04.670214 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:04.681415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5ea5f522-6b4d-432b-b5c7-68109a3e01f1 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1264 microversion: 2.1 time: 0.163343 Jun 07 13:17:04.682322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 316/640] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:04 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:05.531576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:05.532318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:05.539752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.540208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.540976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.541440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.674931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:05.683813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:05.685345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:05.686516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-42eecf1b-1cf1-45fc-abc5-4ad188654a72 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.159707 Jun 07 13:17:05.687068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 325/641] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:05 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:05.699655 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:05.700344 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:05.707055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.707496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.708253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.708684 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.844727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:05.856269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cc84c1c4-85a9-4f39-9222-ecf713bd42db tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1452 microversion: 2.1 time: 0.160199 Jun 07 13:17:05.857179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 317/642] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:05 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:05.874461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:05.875158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:05.881423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.881872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:05.882627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:05.883061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:06.017834 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:06.026115 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2677c1eb-80de-4368-9cf2-fd795eee0bb8 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1452 microversion: 2.1 time: 0.155941 Jun 07 13:17:06.026706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 326/643] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:05 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:06.706515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:06.707315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:06.715255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:06.716007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:06.716852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:06.717352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:06.874865 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:06.884765 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:06.886507 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:06.887758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-68dfb0a9-82ed-445f-8bc9-717858ee9109 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.185601 Jun 07 13:17:06.888485 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 318/644] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:06 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:07.040021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:07.041982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:07.051513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.051965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.052743 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.053209 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.077949 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'flavor' on Instance uuid 663070f2-dcaf-42cf-9c22-4eaee57bc189 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:17:07.209214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9e125900-48d3-45e9-91a3-e88fe0ea78cb tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/action" status: 200 len: 32 microversion: 2.1 time: 0.174953 Jun 07 13:17:07.210199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 327/645] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:07 2022] POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:17:07.220896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:07.222360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:07.230542 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.231126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.232017 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.232511 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.394142 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:07.403549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d0248915-747c-4590-b630-84b29ba4efbd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.187894 Jun 07 13:17:07.404131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 319/646] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:07 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:07.907902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:07.908712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:07.917262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.917710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:07.918521 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:07.919431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.221393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:08.231514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:08.233056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:08.234444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f087c53d-3aab-4a49-b33d-a7410bbff5cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.330860 Jun 07 13:17:08.235302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 328/647] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:07 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:08.351819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-05e9497c-9b83-4cb6-abd4-6a4b37590834 req-3a81d3fc-4ff0-4d41-8af5-cfff1fb1ac53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f08c6a-dd16-4928-a462-8c396f9608a6", "tag": "b2917f80-dcb9-4be9-8700-b022a43d153c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:08.359794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-05e9497c-9b83-4cb6-abd4-6a4b37590834 req-3a81d3fc-4ff0-4d41-8af5-cfff1fb1ac53 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:08.360233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-05e9497c-9b83-4cb6-abd4-6a4b37590834 req-3a81d3fc-4ff0-4d41-8af5-cfff1fb1ac53 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.372823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-05e9497c-9b83-4cb6-abd4-6a4b37590834 req-3a81d3fc-4ff0-4d41-8af5-cfff1fb1ac53 service nova] Creating event network-changed:b2917f80-dcb9-4be9-8700-b022a43d153c for instance a6f08c6a-dd16-4928-a462-8c396f9608a6 on hv-cinder-84496 Jun 07 13:17:08.378961 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-05e9497c-9b83-4cb6-abd4-6a4b37590834 req-3a81d3fc-4ff0-4d41-8af5-cfff1fb1ac53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093461 Jun 07 13:17:08.379536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 320/648] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:08.421710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:08.422579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:08.429319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:08.429862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.430698 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:08.431198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:08.648375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:08.657911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff3b79d2-302a-4ce8-b6d0-cf0efcfa64e2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.240008 Jun 07 13:17:08.658469 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 329/649] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:08 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:09.255101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:09.255796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:09.262493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.262936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.263730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.264160 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.398548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:09.411592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:09.413337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:09.414637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa2eec9d-8500-4c92-8828-76c6eede741c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.164170 Jun 07 13:17:09.415652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 321/650] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:09 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:09.504759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-08c9c643-2b46-4abf-b078-8c48ac15631f req-fc80bfd2-7b58-4d93-81e9-11536b696fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "name": "network-vif-plugged", "status": "completed", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:09.515139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-08c9c643-2b46-4abf-b078-8c48ac15631f req-fc80bfd2-7b58-4d93-81e9-11536b696fde service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.515410 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-08c9c643-2b46-4abf-b078-8c48ac15631f req-fc80bfd2-7b58-4d93-81e9-11536b696fde service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.527687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-08c9c643-2b46-4abf-b078-8c48ac15631f req-fc80bfd2-7b58-4d93-81e9-11536b696fde service nova] Creating event network-vif-plugged:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:17:09.532966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-08c9c643-2b46-4abf-b078-8c48ac15631f req-fc80bfd2-7b58-4d93-81e9-11536b696fde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Jun 07 13:17:09.533979 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 330/651] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:09.675782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:09.676392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:09.682956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.683400 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.684198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:09.684641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:09.823021 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:09.831604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-420b5858-6351-4932-af75-134b65592296 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.159713 Jun 07 13:17:09.832175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 322/652] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:09 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:10.437903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:10.438946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:10.449408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.450092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:10.451259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.451933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:10.592880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:10.602170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:10.603656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:10.604851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4bcad557-fd06-4d92-bba2-3b6baf007fbb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.174015 Jun 07 13:17:10.605447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 331/653] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:10 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:10.851438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:10.852352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:10.859807 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.860425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:10.861243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:10.861729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:10.882978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:11.008620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:11.017063 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f15abd4d-2a6a-44d0-85cc-2b4d122a31d8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.170794 Jun 07 13:17:11.017685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 323/654] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:10 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:11.627849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:11.628760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:11.636710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:11.637196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:11.637954 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:11.638390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:11.653271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:11.775554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:11.789221 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:11.791610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:11.793420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-58272493-3230-4db9-86cb-dab9b2463674 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.172091 Jun 07 13:17:11.794039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 332/655] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:11 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:12.039048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:12.039966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:12.050888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.051624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.052891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.053589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.194591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:12.202753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2967a830-2703-4629-bd8d-079ed5a2e006 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.170547 Jun 07 13:17:12.203318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 324/656] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:12 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:12.811940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:12.812548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:12.819512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.819968 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.820741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:12.821239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:12.957041 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:12.965773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:12.967403 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:12.968675 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca1d9735-f71e-4bc3-ac4e-7c0504229496 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1806 microversion: 2.20 time: 0.160616 Jun 07 13:17:12.969479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 333/657] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:12 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:13.220290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:13.220895 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:13.228091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.228844 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:13.229830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.230246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:13.372339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:13.385430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1c864516-04c0-4cd8-b6be-2ad80a0e8f30 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.168696 Jun 07 13:17:13.386320 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 325/658] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:13 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:13.990175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:13.990175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:13.996399 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.996870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:13.997680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:13.998117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.134539 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:14.143450 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:14.144928 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:14.146104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7027b051-f1fd-4fe3-832a-d1b543ea8f7f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1793 microversion: 2.20 time: 0.161880 Jun 07 13:17:14.146660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 334/659] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:17:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1793 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:17:14.408208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:14.408809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:14.417323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.417772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.418510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:14.418945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:14.553797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:14.566144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-79b6b893-916e-4103-8c7e-29ed32d39992 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.162311 Jun 07 13:17:14.566934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 326/660] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:14 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:15.587302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:15.587843 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:15.595036 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:15.595478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:15.596246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:15.596685 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:15.738126 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:15.746573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b8820154-e0be-41fa-a6be-00aebc5e5a2b tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.164589 Jun 07 13:17:15.747110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 335/661] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:15 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:16.770979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:16.771999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:16.783137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.783885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.785196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:16.785924 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:16.939269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:16.951477 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b48b0722-b2a6-4fad-a481-8970030358fe tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.189880 Jun 07 13:17:16.952227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 327/662] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:16 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:17.969577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:17.970178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:17.977253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:17.977699 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:17.978458 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:17.978887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:18.119285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:18.127855 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca1b3cde-d194-40a2-85cf-c1f986c2acfd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.162218 Jun 07 13:17:18.128443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 336/663] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:17 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:19.150156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:19.151213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:19.162192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:19.162933 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:19.163699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:19.164129 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:19.305500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:19.313746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d7820e63-32d7-40ac-a3d8-b9bad20e99bc tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.170305 Jun 07 13:17:19.314325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 328/664] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:19 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:20.335722 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:20.336534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:20.347700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:20.348449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:20.349786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:20.350674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:20.497536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:20.509543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8b3935c0-4b19-411a-8aef-da9b51dbc84e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.180725 Jun 07 13:17:20.510123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 337/665] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:20 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:21.527968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:21.528595 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:21.535460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:21.535905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:21.536658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:21.537140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:21.671578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:21.679955 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ccfbafbc-c48e-4e8e-82ae-804d542ba0a7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.156007 Jun 07 13:17:21.680501 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 329/666] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:21 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:22.698884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:22.699497 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:22.706663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:22.707121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:22.707886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:22.708324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:22.861757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:22.870166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fa9812dd-8321-465c-9a9c-eccb063dcf3c tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.175223 Jun 07 13:17:22.871092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 338/667] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:22 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:23.894051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:23.894904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:23.903782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:23.904235 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:23.905035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:23.905489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:24.043385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:24.055850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-da9cc830-ecd3-42fb-b51a-d4eddd445446 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.168304 Jun 07 13:17:24.056719 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 330/668] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:23 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:25.078558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:25.079388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:25.090707 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:25.091442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:25.092839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:25.093652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:25.244415 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:25.253082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-daee8c97-2a9d-4736-aca1-d2cee3b252b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.182031 Jun 07 13:17:25.253610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 339/669] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:25 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:26.273947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:26.274951 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:26.283993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:26.284585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:26.285662 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:26.286254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:26.423373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:26.431823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fc5527d7-5197-4087-9b63-5e6557c8fe6f tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1735 microversion: 2.1 time: 0.163197 Jun 07 13:17:26.432399 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 331/670] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:26 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:27.450246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:27.450889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:27.459770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.460420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.461629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.462273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.593377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:27.601823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ca7c02ed-1d8b-4f6c-ae67-b243bd642922 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1715 microversion: 2.1 time: 0.156207 Jun 07 13:17:27.602395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 340/671] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:27 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:27.658663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:27.659193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:27.666007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.666461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.667220 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.667653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.797996 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] HTTP exception thrown: Cannot 'detach_volume' instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 while it is in vm_state rescued Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Request method failure captured: Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments/5dd37fb9-06eb-4399-a958-7ff555a24786 HTTP/1.1 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06eGuqdRjbH-nvavcHPNBP1PuSaoAGC1cl3LGhVXw_niqaD6gUKqcfjfBZan1ImohNd1oD-sYDqHSthN0-lDH07HJNroW8eWYlGmTddNxMaNBRusvdJxp1S-mUhe9r6DSFaeetXaa7BYiZbvPeZLzPB3nj9xjGj82Z6wQ_Mx4b2jNU Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:17:27.799610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9cf247a413d45049be49368cbce7213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9cf247a413d45049be49368cbce7213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 025ca1d10d5e49e984c7fd4e0b425f08 Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:17:27.800991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Cannot 'detach_volume' instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 while it is in vm_state rescued Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '663070f2-dcaf-42cf-9c22-4eaee57bc189', 'id': '5dd37fb9-06eb-4399-a958-7ff555a24786'} Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:17:27.801813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 while it is in vm_state rescued Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 while it is in vm_state rescued Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:17:27.803090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Returning 409 to user: Cannot 'detach_volume' instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 while it is in vm_state rescued {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:17:27.804084 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-56489716-1826-4de5-93a4-f47a72061e9a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments/5dd37fb9-06eb-4399-a958-7ff555a24786" status: 409 len: 152 microversion: 2.1 time: 0.146400 Jun 07 13:17:27.804084 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 332/672] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:17:27 2022] DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments/5dd37fb9-06eb-4399-a958-7ff555a24786 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:17:27.810308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:27.810846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:27.817441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.817926 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.818685 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.819117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.892087 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-163eb154-1a14-477e-983c-6e2d83de852d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/action" status: 202 len: 0 microversion: 2.1 time: 0.085554 Jun 07 13:17:27.892759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 341/673] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:27 2022] POST /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:17:27.902429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:27.903033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:27.909948 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.910375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:27.911134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:27.911548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:28.049884 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:28.059011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-43befb40-f7ec-48d7-85ae-b9ccf3f679b9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1723 microversion: 2.1 time: 0.161433 Jun 07 13:17:28.059941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 333/674] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:27 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:29.081986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:29.082567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:29.085336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=46 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:29.091550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:29.091997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:29.092766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:29.093237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:29.231440 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:29.243674 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3e41ac6b-30b7-407d-9083-11f850089f13 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1723 microversion: 2.1 time: 0.169332 Jun 07 13:17:29.244861 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 342/675] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:29 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:30.266980 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:30.267963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:30.279019 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:30.279756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:30.281060 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:30.281770 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:30.416291 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:30.424459 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-472cab45-46e5-441e-8b68-b1380c06464d tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1723 microversion: 2.1 time: 0.164043 Jun 07 13:17:30.425045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 334/676] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:30 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:31.446152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:31.447445 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:31.458482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:31.459231 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:31.460501 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:31.461272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:31.604778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:31.614924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-daeb5982-3a69-474e-aa43-7a0a4b08ea35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1723 microversion: 2.1 time: 0.175059 Jun 07 13:17:31.615756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 343/677] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:31 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:32.638651 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:32.639252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:32.641653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=44 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:32.647176 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:32.647612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:32.648402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:32.648833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:33.047383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:33.055744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ce562515-4f5c-4f6a-b9de-b44fc7c4a45a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1729 microversion: 2.1 time: 0.421144 Jun 07 13:17:33.056308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 335/678] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:32 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1729 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:33.072486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:33.073198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:33.080044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:33.080492 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:33.081302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:33.081740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:33.167508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d19b4b4b-3f95-4e18-9563-e3437c3ef490 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098981 Jun 07 13:17:33.168126 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 344/679] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:17:33 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:34.047427 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-12c8c813-f3e8-453e-83d6-afa68cef30d1 req-60d765b8-97f5-473f-9a0d-c71da5683db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:34.057050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-12c8c813-f3e8-453e-83d6-afa68cef30d1 req-60d765b8-97f5-473f-9a0d-c71da5683db0 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:34.057568 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-12c8c813-f3e8-453e-83d6-afa68cef30d1 req-60d765b8-97f5-473f-9a0d-c71da5683db0 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:34.070019 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-12c8c813-f3e8-453e-83d6-afa68cef30d1 req-60d765b8-97f5-473f-9a0d-c71da5683db0 service nova] Creating event network-changed:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:17:34.075509 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-12c8c813-f3e8-453e-83d6-afa68cef30d1 req-60d765b8-97f5-473f-9a0d-c71da5683db0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031853 Jun 07 13:17:34.076322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 336/680] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:36.090319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-45f08106-504c-452c-ad73-18efc90f7da2 req-11d4b527-0c56-4ab8-84af-e3f8fb07f867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:36.098488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-45f08106-504c-452c-ad73-18efc90f7da2 req-11d4b527-0c56-4ab8-84af-e3f8fb07f867 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:36.098918 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-45f08106-504c-452c-ad73-18efc90f7da2 req-11d4b527-0c56-4ab8-84af-e3f8fb07f867 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:36.109953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-45f08106-504c-452c-ad73-18efc90f7da2 req-11d4b527-0c56-4ab8-84af-e3f8fb07f867 service nova] Creating event network-changed:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:17:36.114922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-45f08106-504c-452c-ad73-18efc90f7da2 req-11d4b527-0c56-4ab8-84af-e3f8fb07f867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028811 Jun 07 13:17:36.115561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 345/681] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:17:40.700288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:40.700921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:40.707784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.708240 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.709042 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.709491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.735806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lazy-loading 'flavor' on Instance uuid b85f110d-e60a-4075-bba8-a1a9dd548b18 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:17:40.817974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3a4a5e8c-e825-4d17-b096-138eeed1fe16 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "POST /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18/action" status: 202 len: 0 microversion: 2.1 time: 0.126292 Jun 07 13:17:40.818553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 337/682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:40 2022] POST /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:17:40.828832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:40.829541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:40.836441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.836861 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.837938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:40.838412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:40.984160 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:40.992228 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-239268b0-d319-4d68-939e-d92b6d559fa9 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.168931 Jun 07 13:17:40.992805 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 346/683] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:40 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:42.015606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:42.016410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:42.024215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.024709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.025605 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:42.026086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:42.028967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:42.162034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:42.169887 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2ed7b691-b58e-41d7-8cbf-bdd9d470e693 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.160113 Jun 07 13:17:42.170424 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 338/684] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:42 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:43.197053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:43.198005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:43.208716 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.209517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.210787 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:43.211511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:43.215867 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:43.349760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:43.359632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5c51b086-e67e-490a-9bfe-7abf6c1e5c87 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.169791 Jun 07 13:17:43.360206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 347/685] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:43 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:44.380774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:44.381903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:44.390881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.391327 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:44.392093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:44.392525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:44.536942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:44.548983 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de854164-6af1-4401-b753-a94e9ce37a7a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.174264 Jun 07 13:17:44.549834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 339/686] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:44 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:45.574231 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:45.575496 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:45.586408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:45.587154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:45.588428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:45.589196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:45.732688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:45.740527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d93a7853-46aa-4b8c-919a-41b3d0f211ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.173020 Jun 07 13:17:45.741113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 348/687] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:45 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:46.762455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:46.762985 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:46.770253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:46.770720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:46.771519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:46.771969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:46.919578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:46.929339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a64853c4-9d6e-4fab-ad95-cbaf666abb43 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.173449 Jun 07 13:17:46.930156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 340/688] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:46 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:47.669426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:47.669924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:47.676135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.676560 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.677358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.677803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.799335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lazy-loading 'services' on Instance uuid d5202ff0-c8c1-4c4f-a89c-f536f724298f {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:17:47.919464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bd94d348-56c8-4ba5-8995-e115d3b0b358 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments/152852cf-0742-44bb-b45f-9bd98c183de3" status: 202 len: 0 microversion: 2.1 time: 0.366535 Jun 07 13:17:47.920063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 349/689] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:17:47 2022] DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments/152852cf-0742-44bb-b45f-9bd98c183de3 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:17:47.948247 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:47.948939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:47.956455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.956907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:47.957728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:47.958127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:48.104594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:48.112393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4851ee21-a64a-488e-9151-20a513985d72 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.167929 Jun 07 13:17:48.112885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 341/690] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:47 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:49.042193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9f766573-ddd4-43d2-9bf8-eada53afd2f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:49.049050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f766573-ddd4-43d2-9bf8-eada53afd2f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.049504 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9f766573-ddd4-43d2-9bf8-eada53afd2f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.110599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9f766573-ddd4-43d2-9bf8-eada53afd2f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Going to try to stop instance {{(pid=117832) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 13:17:49.130704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:49.131385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:49.139709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.140402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.141779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.142559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.161206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9f766573-ddd4-43d2-9bf8-eada53afd2f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action" status: 202 len: 0 microversion: 2.1 time: 0.123581 Jun 07 13:17:49.161816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 350/691] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:49 2022] POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:17:49.170917 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:49.171885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:49.178151 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.178494 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.179261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:49.179690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:49.287836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:49.295519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e6e8ce50-0272-4fde-adca-c0932599d357 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.168660 Jun 07 13:17:49.296206 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 342/692] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:49 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:49.315935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:49.323571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da60d053-f55b-40ca-a069-423b1bd318c1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.156850 Jun 07 13:17:49.324176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 351/693] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:49 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:17:50.316378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:50.317282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:50.328016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.328468 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.329384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.329822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.341432 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:50.342017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:50.349377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.349822 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.350581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:50.351012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:50.466083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:50.473988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0dd6b3d7-fcd9-4d7c-9616-e2029a3a368a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.164653 Jun 07 13:17:50.474531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 343/694] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:50 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:50.485550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:50.493279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21aba84a-266f-4031-8c26-4553e4c07704 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.155628 Jun 07 13:17:50.493836 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 352/695] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:50 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:51.495525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:51.496875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:51.504054 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.504497 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.505337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.505766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.511692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:51.512305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:51.518986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.519435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.520199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:51.520638 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:51.644609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:51.652412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-510dea94-159a-47ab-b8d2-e3e920e74395 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.163628 Jun 07 13:17:51.652819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 344/696] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:51 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:51.654931 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:51.664502 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0b722cc6-14c3-4b4c-81fa-227ebb9b7e95 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.156967 Jun 07 13:17:51.665105 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 353/697] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:51 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:52.669678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:52.670282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:52.677386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.677845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.678870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.679316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.682631 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:52.683295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:52.690455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.690897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.691662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:52.695802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:52.816429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:52.824233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fba52ca2-c169-4b3d-b903-d30860efbbba tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.158498 Jun 07 13:17:52.825487 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 345/698] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:52 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:52.919314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:52.927774 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd550469-4848-426f-95e7-6eeb44d12b5f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.249174 Jun 07 13:17:52.928351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 354/699] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:52 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:53.843937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:53.844523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:53.852199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.852695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.853587 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.854071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.945880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:53.946637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:53.953448 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.953910 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.954684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:53.955113 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:53.994286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:54.002876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa39d454-a6d7-480e-b1b1-85c0973a75c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.164409 Jun 07 13:17:54.003459 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 346/700] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:53 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:54.091058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:54.102706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5ba61e89-bdb5-4115-ba32-90c0c0c3c74e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.160281 Jun 07 13:17:54.103524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 355/701] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:53 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:55.020406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:55.020984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:55.028060 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.028516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.029327 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.029770 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.121985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:55.122592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:55.129218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.129662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.130424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:55.130853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:55.165300 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:55.173557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f9c671e4-35be-4e96-bce5-53163cf5966f tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.157074 Jun 07 13:17:55.174111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 347/702] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:55 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:55.263152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:55.270875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6ca680f4-a17f-43ce-811e-1a4a6d02041f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.153089 Jun 07 13:17:55.271357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 356/703] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:55 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:56.192319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:56.192954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:56.199758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.200641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.201380 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.201981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.291525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:56.292835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:56.299550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.300081 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.300865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:56.301321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:56.337854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:56.345872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a7738b41-68aa-437e-9a8e-c3c71533bc9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.159485 Jun 07 13:17:56.346478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 348/704] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:56 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:56.518646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:56.528906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a28aa09e-cf32-42c5-829e-8dc7a71019c7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.240915 Jun 07 13:17:56.530028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 357/705] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:56 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:57.366465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:57.367072 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:57.376161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.376608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.377416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.377841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.514397 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.522533 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-188347ff-4290-4fb6-8a47-b31aaa3578bc tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.162539 Jun 07 13:17:57.523116 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 349/706] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:57 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:57.554232 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:57.554782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:57.561915 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.562395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.563166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:57.563600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:57.711029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:57.719050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-436f087b-a998-4f5a-817b-71fb7344f4b1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.168652 Jun 07 13:17:57.719581 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 358/707] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:57 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:58.539913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:58.540518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:58.547429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.547872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.548649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.549089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.688727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.696410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-381a1cbe-307c-463d-9527-5ec6dda6d9db tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.160430 Jun 07 13:17:58.696976 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 350/708] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:58 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:58.735975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:58.736583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:58.743147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.743592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.744350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:58.745179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:58.879295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:58.887423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f6751364-b13d-41dc-8943-65984d37ea72 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1678 microversion: 2.1 time: 0.155518 Jun 07 13:17:58.887998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 359/709] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:58 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:59.716997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:59.718030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.724779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.725264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.726032 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.726466 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.874260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:17:59.886560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-83f278c0-1a38-4f22-8ba2-4b7a47702880 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1510 microversion: 2.1 time: 0.175757 Jun 07 13:17:59.887330 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 351/710] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:59 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:17:59.904081 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:17:59.904617 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:17:59.904733 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.905289 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:17:59.907345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=36 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:17:59.911670 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.912119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.912677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.912893 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.913210 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.913362 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:17:59.913976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:17:59.914411 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.046826 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.052529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5814f1ac-3dfe-4222-b35d-39135d79bcdd tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "POST /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18/action" status: 202 len: 0 microversion: 2.1 time: 0.151962 Jun 07 13:18:00.053470 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 360/711] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:17:59 2022] POST /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:00.054731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b1c23a17-0371-41e5-af03-a8b077de4ddc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1655 microversion: 2.1 time: 0.153988 Jun 07 13:18:00.055425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 352/712] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:17:59 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:00.061435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:00.062136 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:00.068647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.069518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.070270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.070783 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.071008 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-68f9d635-0c38-463b-aaec-846c3d69fa22 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:00.074879 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:00.079464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68f9d635-0c38-463b-aaec-846c3d69fa22 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.079919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-68f9d635-0c38-463b-aaec-846c3d69fa22 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.114324 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-68f9d635-0c38-463b-aaec-846c3d69fa22 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Going to try to start instance {{(pid=117833) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 13:18:00.152500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:00.164441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-68f9d635-0c38-463b-aaec-846c3d69fa22 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action" status: 202 len: 0 microversion: 2.1 time: 0.096948 Jun 07 13:18:00.165869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 353/713] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:18:00 2022] POST /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:18:00.174348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:00.175183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:00.182384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.182976 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.183936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:00.184644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:00.231757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.240649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da4cb6c2-60b8-4de9-b01a-ce83fe363754 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1518 microversion: 2.1 time: 0.183051 Jun 07 13:18:00.245123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 361/714] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:18:00.363538 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:00.371671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2b2cf58d-2c9b-4945-b118-83cd65a9b403 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1664 microversion: 2.1 time: 0.201960 Jun 07 13:18:00.372651 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 354/715] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:00 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:01.258482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.259058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:01.266297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.266744 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.267507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.267944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.390103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:01.390664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:01.397575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.398040 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.398824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.399255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.408180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.415799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e139158c-b8cc-4c4f-9aa8-dc2e33a21e9b tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1520 microversion: 2.1 time: 0.161332 Jun 07 13:18:01.416388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 362/716] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:01.540658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:01.549649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5c7b5963-831b-4a9d-910f-a6a49e22a56c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1664 microversion: 2.1 time: 0.163702 Jun 07 13:18:01.550626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 355/717] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:01 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:01.749324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-058b4b5b-cbf9-4f31-9f68-3c8e54c1737f req-7317abea-aea5-4ece-869a-8490827f038a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "name": "network-vif-unplugged", "status": "completed", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:01.757875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-058b4b5b-cbf9-4f31-9f68-3c8e54c1737f req-7317abea-aea5-4ece-869a-8490827f038a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:01.758380 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-058b4b5b-cbf9-4f31-9f68-3c8e54c1737f req-7317abea-aea5-4ece-869a-8490827f038a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:01.769386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.compute.server_external_events [req-058b4b5b-cbf9-4f31-9f68-3c8e54c1737f req-7317abea-aea5-4ece-869a-8490827f038a service nova] Unable to find a host for instance b85f110d-e60a-4075-bba8-a1a9dd548b18. Dropping event network-vif-unplugged {{(pid=117832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:18:01.770258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-058b4b5b-cbf9-4f31-9f68-3c8e54c1737f req-7317abea-aea5-4ece-869a-8490827f038a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079160 Jun 07 13:18:01.770835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 363/718] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:18:02.435802 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.436685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:02.446463 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.447131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.448310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.448981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.571800 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:02.572557 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:02.580795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.581408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.582194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:02.582631 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:02.595881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.603824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e87ff48c-c04a-41e5-b447-d647440844c1 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.174138 Jun 07 13:18:02.605162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 356/719] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:02.754316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:02.762357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9904b5d1-6b83-483c-ba21-466dddb4f497 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1668 microversion: 2.1 time: 0.194457 Jun 07 13:18:02.762962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 364/720] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:02 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1668 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:03.626823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:03.627416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:03.629903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=44 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:03.635417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.635845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.636603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:03.637046 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:03.772548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:03.780247 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a8bd109-4746-44ef-aa26-b4c96a1bba6c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.157391 Jun 07 13:18:03.781111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 357/721] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:03 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:04.801130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:04.802122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:04.812928 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.813422 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.814194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:04.814621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:04.948549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:04.959660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-013706b3-e0de-4f91-91dd-7fc5873de57d tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.164756 Jun 07 13:18:04.960401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 365/722] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:04 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:05.983395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:05.984026 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:05.991203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.991653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:05.992420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:05.992827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:06.129766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:06.137479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8544e9cb-c569-4bec-a9b6-aa073be114df tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.160316 Jun 07 13:18:06.138055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 358/723] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:05 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:07.158523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:07.159289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:07.168322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.168877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.169896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:07.170431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:07.305991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:07.314751 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c283e52-690b-4a5d-99aa-07b79487dfc0 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.162150 Jun 07 13:18:07.315352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 366/724] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:07 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:08.335335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:08.335905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:08.345298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.345963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.347097 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:08.347679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:08.509394 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:08.517830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-271ceb6a-8e59-42b7-8657-f53fa25769ca tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.189119 Jun 07 13:18:08.518417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 359/725] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:08 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:09.540960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:09.541609 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:09.549718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.550173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.550927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:09.551362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:09.694522 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:09.705704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41f10a92-4d33-4b8d-946e-37a3a622f169 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.168692 Jun 07 13:18:09.706281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 367/726] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:09 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:10.724611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:10.725264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:10.732303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.732750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.733560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:10.733999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:10.873279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:10.881112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-83230c33-a923-4413-813e-d3d79583dd62 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.160524 Jun 07 13:18:10.881750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 360/727] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:10 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:11.900427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:11.901102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:11.911106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.911776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:11.912951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:11.913702 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:12.050208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:12.058299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6be0aade-122c-4f6f-86d0-aeede3911c41 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.163547 Jun 07 13:18:12.058922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 368/728] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:11 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:13.079886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.080963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.092138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.093073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.094378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.095087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.228362 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:13.238733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-41fefb3c-21e6-4cf1-b5ea-31eb95b42651 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.165273 Jun 07 13:18:13.239466 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 361/729] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:13.476997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.477954 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.487782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.488231 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.488994 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.489459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.528085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5dc627c0-47eb-4585-adaa-81e86dbc6033 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments/42b51fe7-f011-4c2c-abfe-633f1a0f5976" status: 200 len: 194 microversion: 2.20 time: 0.057899 Jun 07 13:18:13.528654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 369/730] 10.222.0.20 () {60 vars in 1453 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments/42b51fe7-f011-4c2c-abfe-633f1a0f5976 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:18:13.593504 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.593994 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.600724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.601198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.601942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.602367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.683494 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lazy-loading 'services' on Instance uuid 4f0a617c-95aa-46f2-8159-056830649054 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:13.800055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3507366e-c17c-4a4e-88c0-705ff88617c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments/42b51fe7-f011-4c2c-abfe-633f1a0f5976" status: 202 len: 0 microversion: 2.20 time: 0.210386 Jun 07 13:18:13.800851 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 362/731] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jun 7 13:18:13 2022] DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments/42b51fe7-f011-4c2c-abfe-633f1a0f5976 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:13.809266 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:13.810277 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:13.817823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.818561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.819548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.820184 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.823430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9e5fd578-6b9e-44e6-aeaa-da6ac6cb07e7 req-fc6840e0-e6a9-4122-b9a9-0b3c9c6fabbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "name": "network-vif-plugged", "status": "completed", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:13.840254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9e5fd578-6b9e-44e6-aeaa-da6ac6cb07e7 req-fc6840e0-e6a9-4122-b9a9-0b3c9c6fabbd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:13.840254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9e5fd578-6b9e-44e6-aeaa-da6ac6cb07e7 req-fc6840e0-e6a9-4122-b9a9-0b3c9c6fabbd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:13.852795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9e5fd578-6b9e-44e6-aeaa-da6ac6cb07e7 req-fc6840e0-e6a9-4122-b9a9-0b3c9c6fabbd service nova] Creating event network-vif-plugged:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:18:13.854328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bc0c603-2f83-417f-b013-02cb5a4bfd6a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049123 Jun 07 13:18:13.855140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 370/732] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jun 7 13:18:13 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 13:18:13.860576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9e5fd578-6b9e-44e6-aeaa-da6ac6cb07e7 req-fc6840e0-e6a9-4122-b9a9-0b3c9c6fabbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042614 Jun 07 13:18:13.861309 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 363/733] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:14.264286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.265319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.273206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.273651 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.274410 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.274839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.427482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:14.435495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eb5ed3ac-57c2-413a-bac4-adea5b4b7403 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.177607 Jun 07 13:18:14.436076 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 371/734] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:14.873080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:14.875119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:14.886428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.887163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.888411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:14.889165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:14.924487 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-be313b01-7065-41d7-a118-02891c22803d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059439 Jun 07 13:18:14.925402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 364/735] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jun 7 13:18:14 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:18:15.454481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.455157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.463470 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.464028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.464971 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.465551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.605199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:15.613478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41c0fb1c-6a1b-4478-9251-8faec3386edb tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1576 microversion: 2.1 time: 0.164008 Jun 07 13:18:15.614051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 372/736] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:15.937048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:15.938032 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:15.945638 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.946077 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:15.946852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:15.947319 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.141191 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9ec7246d-df77-4221-9166-f31a0bc5b372 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.208096 Jun 07 13:18:16.141711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 365/737] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jun 7 13:18:15 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054/os-volume_attachments => generated 25 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:16.201835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.202254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.208601 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.209043 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.209816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.210238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.235130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:18:16.322784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0341f4c-e003-492a-81fb-01ceb7d250fd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 204 len: 0 microversion: 2.20 time: 0.124602 Jun 07 13:18:16.323366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 373/738] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jun 7 13:18:16 2022] DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:18:16.332125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.332731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.338891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.339332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.340090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.340516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.481230 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:16.490618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:16.492188 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:16.493407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e81345f0-38f3-4c19-8f35-122d3a92d22b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.165559 Jun 07 13:18:16.493924 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 366/739] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:16.632016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:16.632730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:16.639672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.640088 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.640882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:16.641475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:16.778342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:16.787463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f53f27b9-a5ae-4486-9941-56b90cc57eb6 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1563 microversion: 2.1 time: 0.159891 Jun 07 13:18:16.788040 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 374/740] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:16 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:17.516336 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:17.516978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:17.524407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.524878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.525975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:17.526404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:17.664587 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.672831 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.674987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:17.676150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2e1a1335-5d60-4b65-9822-bd98339105a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.165165 Jun 07 13:18:17.676701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 367/741] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:17 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:18.695704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:18.696311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:18.703491 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.703940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.704722 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:18.705364 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:18.956100 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.964636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.966178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:18.967388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-700f5e2e-585d-4fbe-919e-8fe9a251a5c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 200 len: 1721 microversion: 2.20 time: 0.275804 Jun 07 13:18:18.967984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 375/742] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:18 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:19.402401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-8fdb39ea-29e1-4adc-a3a4-007b15eefb8c req-7f2ede58-83b3-4b9c-9d87-35c14a0bf13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0a617c-95aa-46f2-8159-056830649054", "name": "network-vif-deleted", "tag": "5192c62f-d8c6-4ff1-88e1-16c2a8f9e987"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:19.427315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8fdb39ea-29e1-4adc-a3a4-007b15eefb8c req-7f2ede58-83b3-4b9c-9d87-35c14a0bf13c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.427757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8fdb39ea-29e1-4adc-a3a4-007b15eefb8c req-7f2ede58-83b3-4b9c-9d87-35c14a0bf13c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.442554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-8fdb39ea-29e1-4adc-a3a4-007b15eefb8c req-7f2ede58-83b3-4b9c-9d87-35c14a0bf13c service nova] Creating event network-vif-deleted:5192c62f-d8c6-4ff1-88e1-16c2a8f9e987 for instance 4f0a617c-95aa-46f2-8159-056830649054 on hv-cinder-84496 Jun 07 13:18:19.450745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-8fdb39ea-29e1-4adc-a3a4-007b15eefb8c req-7f2ede58-83b3-4b9c-9d87-35c14a0bf13c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051295 Jun 07 13:18:19.451353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 368/743] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:19.987755 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:19.989072 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:19.996680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.997637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:19.998692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:19.999134 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:20.014441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 HTTP/1.1 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:18:20.016385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:18:20.018723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '4f0a617c-95aa-46f2-8159-056830649054'} Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:20.019683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:18:20.021187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:20.023740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:20.024608 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0d602ccc-7ae8-4d60-895c-16d6cb4e8f9d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 404 len: 111 microversion: 2.20 time: 0.041331 Jun 07 13:18:20.025193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 376/744] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:19 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:18:20.035083 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f08afb97-f0b8-4a6f-a7af-e644f8b1a33a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '.version_select at 0x7f20a472b670>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:20.060624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f08afb97-f0b8-4a6f-a7af-e644f8b1a33a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376221652" status: 204 len: 0 microversion: 2.20 time: 0.030362 Jun 07 13:18:20.061332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 369/745] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Jun 7 13:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376221652 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:18:20.745525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f0099169-340e-4434-b82b-a9a297c8a4e0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: .version_select at 0x7f20a46b83a0>, body: {"keypair": {"name": "tempest-keypair-1807239812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXZyqr3Poqm+eNATqzverHgdohBmZMIUpXY++tMZnK2uZSFVvwK8FGE/diKDGFMUdrMTcGz3HIfex9dFvktFnGBNB7Vz7SLWLtUBiq2284p0dxFv6FrhonBcRvtpRk2nA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:20.760877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f0099169-340e-4434-b82b-a9a297c8a4e0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for project 6c6b89da4e96480ba68652cff770b388. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:20.765295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-f0099169-340e-4434-b82b-a9a297c8a4e0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for user 8b341180925b454094d9bf5e6f5b3eaf and project 6c6b89da4e96480ba68652cff770b388. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:20.790121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f0099169-340e-4434-b82b-a9a297c8a4e0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048938 Jun 07 13:18:20.796170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 377/746] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jun 7 13:18:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 13:18:22.131668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2040141869", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11e6938c-b8f3-4ebe-9f3a-91e0b1c73c1c"}], "security_groups": [{"name": "tempest-securitygroup--336802314"}], "key_name": "tempest-keypair-1807239812", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:22.248907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] validate_networks() for [('11e6938c-b8f3-4ebe-9f3a-91e0b1c73c1c', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:18:22.669110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:18:22.669530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:18:22.669999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:18:22.670402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:18:22.670799 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:18:22.680253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.680699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.681557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:22.681992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:22.699413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for project 6c6b89da4e96480ba68652cff770b388. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:22.703817 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Getting quotas for user 8b341180925b454094d9bf5e6f5b3eaf and project 6c6b89da4e96480ba68652cff770b388. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:22.716302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:18:22.718835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:18:22.774668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b27b1423-8a3d-44b0-98b8-a865f7253c45 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.648263 Jun 07 13:18:22.775310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 370/747] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jun 7 13:18:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 13:18:22.786188 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:22.786795 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:22.841585 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.849472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.850991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:22.852070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c0c8d160-61e8-45e4-84c7-af23547149b3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1282 microversion: 2.20 time: 0.070447 Jun 07 13:18:22.852807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 378/748] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:22 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:23.871818 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:23.872364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:23.879100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.879544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.880314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:23.880777 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:23.952070 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.960450 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.962089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:23.963189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6f171854-eaac-4a73-82f1-93b6a22dfb2c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1352 microversion: 2.20 time: 0.096566 Jun 07 13:18:23.963755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 371/749] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:23 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:24.982979 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:24.983597 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:24.990459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.990903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:24.991812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:24.992274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.008299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:25.203446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.212565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.214062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:25.215175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0616c238-7363-4158-a765-cf965cb3bffd tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.237505 Jun 07 13:18:25.215896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 379/750] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:24 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:25.402093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-41e3f15c-ba2d-478b-9157-c4c32afa97b1 req-a54c3c96-af46-4bc3-bd39-58988ed651c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:25.413064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-41e3f15c-ba2d-478b-9157-c4c32afa97b1 req-a54c3c96-af46-4bc3-bd39-58988ed651c3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:25.413738 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-41e3f15c-ba2d-478b-9157-c4c32afa97b1 req-a54c3c96-af46-4bc3-bd39-58988ed651c3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:25.431744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-41e3f15c-ba2d-478b-9157-c4c32afa97b1 req-a54c3c96-af46-4bc3-bd39-58988ed651c3 service nova] Creating event network-changed:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:18:25.436735 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-41e3f15c-ba2d-478b-9157-c4c32afa97b1 req-a54c3c96-af46-4bc3-bd39-58988ed651c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038432 Jun 07 13:18:25.437867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 372/751] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:26.234546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:26.235151 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:26.243337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.243974 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.245368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:26.245981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:26.381778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.389999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.391510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:26.392662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc06baca-e6a6-4c7f-93c0-9f0d1fdc5890 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.162509 Jun 07 13:18:26.393302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 380/752] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:26 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:27.414885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:27.415927 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:27.422880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.423378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.424228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:27.424708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:27.443625 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:27.570066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.578633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.580256 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:27.581416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3579b018-d460-4c2a-b488-48eb5af824c0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.172376 Jun 07 13:18:27.582062 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 373/753] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:27 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:28.599243 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.599854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.607369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.607842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.608629 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.609093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.831604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.842772 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.844323 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:28.845880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-78036766-c593-4831-9a3a-3d63d06080ad tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.251036 Jun 07 13:18:28.846446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 381/754] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:28 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:28.957420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:28.958092 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:28.964715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.965197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:28.965964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:28.966395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.052156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'services' on Instance uuid 663070f2-dcaf-42cf-9c22-4eaee57bc189 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:29.128104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6d82164c-354d-4c96-a7e8-3cb78f9cc612 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments/5dd37fb9-06eb-4399-a958-7ff555a24786" status: 202 len: 0 microversion: 2.1 time: 0.174809 Jun 07 13:18:29.128696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 374/755] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:18:28 2022] DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments/5dd37fb9-06eb-4399-a958-7ff555a24786 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:29.137262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.138202 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.144673 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.145526 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.146340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.146760 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.176836 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f673ddeb-e3a4-4ee4-90db-4fe4e2bc0df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Jun 07 13:18:29.177428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 382/756] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:29.864715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:29.865367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:29.872203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.872677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:29.873473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:29.873917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.008117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.016864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.018606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.019858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5d6b518a-b8c0-4736-91e9-b676421d8568 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.159513 Jun 07 13:18:30.020629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 375/757] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:29 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:30.189717 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.190558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.193053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:30.198791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.199239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.200019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.200455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.230825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8c37c34a-c48f-43e1-a321-621bd92875f6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045298 Jun 07 13:18:30.231385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 383/758] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:18:30 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:18:30.306396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.306899 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.313097 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.313549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.314312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.314745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.339673 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:18:30.422151 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ed815bd-8c96-419c-9202-5af217de041e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 204 len: 0 microversion: 2.1 time: 0.119287 Jun 07 13:18:30.423092 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 376/759] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:18:30 2022] DELETE /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:30.431836 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:30.432455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:30.438693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.439138 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.440173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:30.440556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:30.586825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:30.598021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-18f65cc2-b720-491f-940a-0057d37d4d06 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1689 microversion: 2.1 time: 0.169784 Jun 07 13:18:30.598877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 384/760] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:30 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:31.039360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:31.040046 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.046998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.047439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.048196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.048626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.193326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.202145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.203649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.204825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47208119-2948-4353-a644-eea9f5b4530b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.170049 Jun 07 13:18:31.205438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 377/761] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:31 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:31.620649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:31.621286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:31.628223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.628671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.629592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.630032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.766441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:31.774223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4894f75d-b182-40ee-a723-4009d7a0d6cd tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1689 microversion: 2.1 time: 0.157919 Jun 07 13:18:31.774811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 385/762] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:31 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:31.875020 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-cfc5e8f5-65ef-49c1-bacc-82c0d2c83d56 req-589a61d3-9abf-4656-933f-2355e6f28eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "name": "network-vif-plugged", "status": "completed", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:31.884189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-cfc5e8f5-65ef-49c1-bacc-82c0d2c83d56 req-589a61d3-9abf-4656-933f-2355e6f28eac service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:31.884664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-cfc5e8f5-65ef-49c1-bacc-82c0d2c83d56 req-589a61d3-9abf-4656-933f-2355e6f28eac service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:31.899911 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-cfc5e8f5-65ef-49c1-bacc-82c0d2c83d56 req-589a61d3-9abf-4656-933f-2355e6f28eac service nova] Creating event network-vif-plugged:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:18:31.904767 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-cfc5e8f5-65ef-49c1-bacc-82c0d2c83d56 req-589a61d3-9abf-4656-933f-2355e6f28eac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033591 Jun 07 13:18:31.905385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 378/763] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:32.227459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:32.228329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:32.238704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.239147 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.239923 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.240351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.382819 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.391428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.392927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.394064 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09614fac-3a3f-4496-80cc-83daa9ce2529 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.173640 Jun 07 13:18:32.394637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 386/764] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:32 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:32.797170 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:32.798297 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:32.802071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:32.802949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:32.809262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.809709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.810461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:32.810886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:32.953585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:32.962616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a959c885-cddc-4b4b-9137-62856b1cfb82 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1689 microversion: 2.1 time: 0.172744 Jun 07 13:18:32.963219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 379/765] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:32 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:33.421400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:33.422144 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:33.425772 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:33.432509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.432952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.433740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.434169 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.584283 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.593302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.594799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:33.595922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1aa79c6b-30a9-4714-93d3-263c323455f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.180980 Jun 07 13:18:33.596499 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 387/766] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:33 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:33.981158 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:33.981737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:33.984173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:33.989743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.990186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:33.990997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:33.991423 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.164790 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.176202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eeba268d-9d7c-4953-bf2f-19b251c3f95a tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1689 microversion: 2.1 time: 0.199344 Jun 07 13:18:34.176970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 380/767] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:33 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:34.614574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:34.615178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:34.622767 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.623265 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.624015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:34.624462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:34.760249 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.768398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.770033 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:34.771149 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9a9fd804-dce5-4992-9aa6-e75aace6feb5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.160565 Jun 07 13:18:34.771749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 388/768] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:34 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:35.194391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:35.195122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:35.202157 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.202631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.203368 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.203963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.278895 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.286941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-531caca0-3894-4423-9e7f-76bf4b326cf8 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1622 microversion: 2.1 time: 0.096511 Jun 07 13:18:35.302011 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 381/769] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:35 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:35.322129 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-105b269e-1fb6-4ea5-b6df-23eaeee18394 req-e52d25a4-2f2e-42e2-a077-a95d3adc6b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663070f2-dcaf-42cf-9c22-4eaee57bc189", "name": "network-vif-deleted", "tag": "3973db08-613d-491c-a398-13fe8d3dd8d1"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:35.330967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-105b269e-1fb6-4ea5-b6df-23eaeee18394 req-e52d25a4-2f2e-42e2-a077-a95d3adc6b7c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.331617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-105b269e-1fb6-4ea5-b6df-23eaeee18394 req-e52d25a4-2f2e-42e2-a077-a95d3adc6b7c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.344096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-105b269e-1fb6-4ea5-b6df-23eaeee18394 req-e52d25a4-2f2e-42e2-a077-a95d3adc6b7c service nova] Creating event network-vif-deleted:3973db08-613d-491c-a398-13fe8d3dd8d1 for instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 on hv-cinder-84496 Jun 07 13:18:35.349848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-105b269e-1fb6-4ea5-b6df-23eaeee18394 req-e52d25a4-2f2e-42e2-a077-a95d3adc6b7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091379 Jun 07 13:18:35.350505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 389/770] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:35.790033 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:35.790653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:35.797525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.797989 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.798785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:35.799227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:35.956651 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.964547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.966078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:35.967844 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7f7e9d5d-220a-4cd1-9535-293e56d55ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1407 microversion: 2.20 time: 0.182595 Jun 07 13:18:35.968633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 382/771] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:35 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:36.305995 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:36.306903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:36.314052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.314606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.315451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.316227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.349459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.349975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.350426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'fault' on Instance uuid 663070f2-dcaf-42cf-9c22-4eaee57bc189 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:36.393346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:36.401990 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b59ac8a4-9532-4dfc-b035-5b395bcb64b7 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 200 len: 1335 microversion: 2.1 time: 0.101516 Jun 07 13:18:36.403170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 390/772] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:36 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:36.990228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:36.991211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:36.998378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:36.998831 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:36.999603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.000061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.140367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.150831 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.152322 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:37.153537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-81559c94-f1c5-4de4-8f56-595fc425854e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1598 microversion: 2.20 time: 0.170131 Jun 07 13:18:37.154082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 383/773] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:18:36 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:18:37.171211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.171705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.178102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.178413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.179185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.179615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.260031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6bbf0c41-34c5-4da4-8a06-323e54ebddce tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092664 Jun 07 13:18:37.260635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 391/774] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:18:37.418959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.419576 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 663070f2-dcaf-42cf-9c22-4eaee57bc189] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:37.426310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.426762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.427543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:37.428174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:37.442959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] HTTP exception thrown: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Request method failure captured: Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 HTTP/1.1 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06eGuqdRjbH-nvavcHPNBP1PuSaoAGC1cl3LGhVXw_niqaD6gUKqcfjfBZan1ImohNd1oD-sYDqHSthN0-lDH07HJNroW8eWYlGmTddNxMaNBRusvdJxp1S-mUhe9r6DSFaeetXaa7BYiZbvPeZLzPB3nj9xjGj82Z6wQ_Mx4b2jNU Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:18:37.444868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9cf247a413d45049be49368cbce7213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9cf247a413d45049be49368cbce7213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 025ca1d10d5e49e984c7fd4e0b425f08 Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. Jun 07 13:18:37.446464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '663070f2-dcaf-42cf-9c22-4eaee57bc189'} Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:37.447356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. Jun 07 13:18:37.448715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:37.450076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Returning 404 to user: Instance 663070f2-dcaf-42cf-9c22-4eaee57bc189 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:37.450076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6ddad7b4-ef6c-4579-b982-4a6e88d57d35 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189" status: 404 len: 111 microversion: 2.1 time: 0.031298 Jun 07 13:18:37.450076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 384/775] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:37 2022] GET /compute/v2.1/servers/663070f2-dcaf-42cf-9c22-4eaee57bc189 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:37.456807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fac1eab8-e6ac-49f0-8a53-b4c6a85cd8f9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '.version_select at 0x7f20a465f670>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:37.477671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fac1eab8-e6ac-49f0-8a53-b4c6a85cd8f9 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047912438" status: 202 len: 0 microversion: 2.1 time: 0.025158 Jun 07 13:18:37.478354 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 392/776] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jun 7 13:18:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047912438 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:18:38.255718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2ae25b8a-c295-44fc-b8e5-4d96e5d1ea21 req-5d90ea61-3638-48ef-a96f-f12462e5d70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:38.264650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2ae25b8a-c295-44fc-b8e5-4d96e5d1ea21 req-5d90ea61-3638-48ef-a96f-f12462e5d70f service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:38.265316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2ae25b8a-c295-44fc-b8e5-4d96e5d1ea21 req-5d90ea61-3638-48ef-a96f-f12462e5d70f service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:38.277196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2ae25b8a-c295-44fc-b8e5-4d96e5d1ea21 req-5d90ea61-3638-48ef-a96f-f12462e5d70f service nova] Creating event network-changed:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:18:38.282904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2ae25b8a-c295-44fc-b8e5-4d96e5d1ea21 req-5d90ea61-3638-48ef-a96f-f12462e5d70f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030922 Jun 07 13:18:38.284052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 385/777] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:40.697757 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.698295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.707963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.708410 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.709231 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.709690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.735114 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:18:40.825279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c892432a-76c7-43c8-bd1e-80d45f47b211 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 204 len: 0 microversion: 2.1 time: 0.131243 Jun 07 13:18:40.825764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 393/778] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:18:40 2022] DELETE /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:40.835197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:40.835979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:40.842623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.843082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.843856 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:40.844294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:40.987119 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:41.000093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1695286d-19c2-43e7-bf04-1cdb7a9c7e91 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1507 microversion: 2.1 time: 0.169578 Jun 07 13:18:41.000913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 386/779] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:40 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:42.018535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:42.019173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:42.026345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.026786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.027548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.027980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:42.164022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:42.172111 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-def3a7d8-4b7e-46f3-aec0-68fe56e64967 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1507 microversion: 2.1 time: 0.157926 Jun 07 13:18:42.172684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 394/780] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:42 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:42.980130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-e271709d-45a1-4ce6-8d1f-ba2971809154 req-b5132dee-c6cf-4da5-ad6b-57900de830d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cd04a7-3053-43a2-8e39-d59bb0687ee4", "name": "network-vif-deleted", "tag": "f1126c3b-69b8-4c60-9364-0df57e08c60a"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:42.989959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e271709d-45a1-4ce6-8d1f-ba2971809154 req-b5132dee-c6cf-4da5-ad6b-57900de830d5 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:42.990416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-e271709d-45a1-4ce6-8d1f-ba2971809154 req-b5132dee-c6cf-4da5-ad6b-57900de830d5 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.003897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-e271709d-45a1-4ce6-8d1f-ba2971809154 req-b5132dee-c6cf-4da5-ad6b-57900de830d5 service nova] Creating event network-vif-deleted:f1126c3b-69b8-4c60-9364-0df57e08c60a for instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 on hv-cinder-84496 Jun 07 13:18:43.009437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-e271709d-45a1-4ce6-8d1f-ba2971809154 req-b5132dee-c6cf-4da5-ad6b-57900de830d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Jun 07 13:18:43.013184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 387/781] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:43.192135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:43.192693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:43.199604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.200052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.200820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.201279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.232082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:43.232529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:43.233004 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'fault' on Instance uuid 17cd04a7-3053-43a2-8e39-d59bb0687ee4 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:43.280935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:43.283449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:43.290268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7e16c4bf-08b4-42b5-9f60-8ebbed9c50f2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 200 len: 1311 microversion: 2.1 time: 0.102172 Jun 07 13:18:43.291009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 395/782] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:43 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:44.310415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:44.311124 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: 17cd04a7-3053-43a2-8e39-d59bb0687ee4] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:44.317902 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.318341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.319101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.319532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.333411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] HTTP exception thrown: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Request method failure captured: Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 HTTP/1.1 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06eGuqdRjbH-nvavcHPNBP1PuSaoAGC1cl3LGhVXw_niqaD6gUKqcfjfBZan1ImohNd1oD-sYDqHSthN0-lDH07HJNroW8eWYlGmTddNxMaNBRusvdJxp1S-mUhe9r6DSFaeetXaa7BYiZbvPeZLzPB3nj9xjGj82Z6wQ_Mx4b2jNU Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:18:44.335030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9cf247a413d45049be49368cbce7213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9cf247a413d45049be49368cbce7213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 025ca1d10d5e49e984c7fd4e0b425f08 Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. Jun 07 13:18:44.336530 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '17cd04a7-3053-43a2-8e39-d59bb0687ee4'} Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:44.337372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. Jun 07 13:18:44.338748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:18:44.340138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Returning 404 to user: Instance 17cd04a7-3053-43a2-8e39-d59bb0687ee4 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:44.340138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-93b84d42-0a8a-4b11-8c22-987b35c5044e tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4" status: 404 len: 111 microversion: 2.1 time: 0.030910 Jun 07 13:18:44.340138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 388/783] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:44 2022] GET /compute/v2.1/servers/17cd04a7-3053-43a2-8e39-d59bb0687ee4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:44.345637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:44.346134 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:44.353769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.354152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.354922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.355357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.380863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:18:44.461362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1ff8ddbd-483e-4a55-afaf-2dac928849e6 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 204 len: 0 microversion: 2.1 time: 0.119538 Jun 07 13:18:44.462057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 396/784] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:18:44 2022] DELETE /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:18:44.470302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:44.470908 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:44.477408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.477849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.478601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:44.479041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:44.615617 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:44.623965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d01e899d-03cf-40cf-94b2-41f7d9b520b2 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.157598 Jun 07 13:18:44.624495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 389/785] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:44 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:45.644045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:45.644870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:45.652042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.652486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.653301 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:45.653730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:45.793781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:45.806463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-685a7fba-74eb-46bc-826b-b5768f3e9572 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.167856 Jun 07 13:18:45.807035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 397/786] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:45 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:46.828028 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:46.828926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:46.837574 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.838024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.838807 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:46.839238 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:46.978509 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:46.986652 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3de76f6f-1459-4c33-8514-6762742ccd39 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1521 microversion: 2.1 time: 0.165682 Jun 07 13:18:46.987217 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 390/787] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:46 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:47.505292 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cb326dff-316a-4a31-a4c5-3fbc77c0f5fa req-fd7de920-f740-46d2-9e00-b7808870646c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf", "name": "network-vif-deleted", "tag": "95c54d86-0d75-40fc-8e67-f43d4eef6799"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:47.514399 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cb326dff-316a-4a31-a4c5-3fbc77c0f5fa req-fd7de920-f740-46d2-9e00-b7808870646c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:47.514839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cb326dff-316a-4a31-a4c5-3fbc77c0f5fa req-fd7de920-f740-46d2-9e00-b7808870646c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:47.527106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cb326dff-316a-4a31-a4c5-3fbc77c0f5fa req-fd7de920-f740-46d2-9e00-b7808870646c service nova] Creating event network-vif-deleted:95c54d86-0d75-40fc-8e67-f43d4eef6799 for instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf on hv-cinder-84496 Jun 07 13:18:47.532260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cb326dff-316a-4a31-a4c5-3fbc77c0f5fa req-fd7de920-f740-46d2-9e00-b7808870646c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030826 Jun 07 13:18:47.532955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 398/788] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:48.010771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:48.011536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:48.018523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.018967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.019736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.020163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.022862 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:48.054627 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:48.055125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:48.055709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lazy-loading 'fault' on Instance uuid d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:18:48.104384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025ca1d10d5e49e984c7fd4e0b425f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9cf247a413d45049be49368cbce7213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:18:48.113803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f5b156e6-aa24-4d76-aa35-eaa076118df5 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 200 len: 1312 microversion: 2.1 time: 0.107594 Jun 07 13:18:48.120216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 391/789] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:48 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:18:49.136072 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:18:49.136848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] [instance: d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:18:49.144205 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:49.144697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.145578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:18:49.146057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:18:49.161042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] HTTP exception thrown: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Request method failure captured: Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf HTTP/1.1 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06eGuqdRjbH-nvavcHPNBP1PuSaoAGC1cl3LGhVXw_niqaD6gUKqcfjfBZan1ImohNd1oD-sYDqHSthN0-lDH07HJNroW8eWYlGmTddNxMaNBRusvdJxp1S-mUhe9r6DSFaeetXaa7BYiZbvPeZLzPB3nj9xjGj82Z6wQ_Mx4b2jNU Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:18:49.162818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9cf247a413d45049be49368cbce7213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9cf247a413d45049be49368cbce7213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9cf247a413d45049be49368cbce7213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: f9cf247a413d45049be49368cbce7213 Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1471032334 Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 025ca1d10d5e49e984c7fd4e0b425f08 Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1471032334-project Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. Jun 07 13:18:49.164431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf'} Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:18:49.165466 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. Jun 07 13:18:49.166778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:18:49.168032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] Returning 404 to user: Instance d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:18:49.168032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e1c889e3-4a49-446e-971c-b23768617555 tempest-ServerRescueNegativeTestJSON-1471032334 tempest-ServerRescueNegativeTestJSON-1471032334-project] 10.222.0.20 "GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf" status: 404 len: 111 microversion: 2.1 time: 0.035053 Jun 07 13:18:49.168032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 399/790] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:18:49 2022] GET /compute/v2.1/servers/d65b4d0b-77c9-4a2c-b7ae-f3a69fc71ddf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:18:58.332962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=25 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:58.333730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=7 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:58.456323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ea0c2801-6e82-4eea-833d-f5b4d635c070 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: .version_select at 0x7f20a4817790>, body: {"keypair": {"name": "tempest-keypair-1995624954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl1GnC4WYO25FA/IChb5hm4fkFbnUg8AxfNQ5Lvr3LYAaQ3sNDHVcjtrIi301GSz3r9mdLdwGyNI0MOPd/jqE90a5c5/schUPeGfG5anVIhrH0AE2e6Gl+VXPw9KfmVSg=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:58.473514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-ea0c2801-6e82-4eea-833d-f5b4d635c070 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:18:58.477929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-ea0c2801-6e82-4eea-833d-f5b4d635c070 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:18:58.505417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ea0c2801-6e82-4eea-833d-f5b4d635c070 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177608 Jun 07 13:18:58.506694 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 392/791] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:18:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:18:59.831124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098814944", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4c5b29e-534b-4458-943d-262c9e18bfb9"}], "security_groups": [{"name": "tempest-securitygroup--192124024"}], "key_name": "tempest-keypair-1995624954", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:18:59.838824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:59.839491 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:18:59.941325 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] validate_networks() for [('a4c5b29e-534b-4458-943d-262c9e18bfb9', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:00.324766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:00.325222 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:00.325692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:00.326095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:00.326582 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:00.335799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.336262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.338418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.338418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.354942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:00.359146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:00.381543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:00.384387 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:00.437548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cab65de7-7c33-4748-b278-f01012aec1f6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.610536 Jun 07 13:19:00.438568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 400/792] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:18:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:19:00.448587 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-060b1af8-54fe-4852-ae8d-ea6919666276 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:00.449389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-060b1af8-54fe-4852-ae8d-ea6919666276 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:00.506689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-060b1af8-54fe-4852-ae8d-ea6919666276 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:00.516949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-060b1af8-54fe-4852-ae8d-ea6919666276 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1242 microversion: 2.1 time: 0.072413 Jun 07 13:19:00.518070 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 393/793] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:00 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:00.808284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:00.809274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:00.815697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.816173 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.817284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.823800 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.858264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9e63e8b8-16b8-40b5-a932-4488f4375e21 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057102 Jun 07 13:19:00.859023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 401/794] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:19:00 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:19:00.930529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:00.931562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:00.938065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.938577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.939668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:00.940105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:00.968132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:19:01.077352 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8a05a9c5-1032-41f5-8bf5-e45b747f620b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 204 len: 0 microversion: 2.1 time: 0.149092 Jun 07 13:19:01.078996 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 394/795] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:00 2022] DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:01.088398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:01.088726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.095326 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.095776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.096559 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.096994 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.268606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:01.276973 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d27dc387-7506-47f9-9c49-31712102d14f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1674 microversion: 2.1 time: 0.193874 Jun 07 13:19:01.277614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 402/796] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:01 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:01.535208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:01.536583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:01.543470 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.543920 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.544738 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:01.545219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:01.614714 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:01.623154 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c06199b7-703b-41e8-b867-89e803e7bb86 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1238 microversion: 2.1 time: 0.092245 Jun 07 13:19:01.623743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 395/797] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:01 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:02.294495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:02.295055 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:02.302140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.302588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.303356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.303799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.442424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.450345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-60895053-2075-4963-b888-3c094f39a9b9 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1674 microversion: 2.1 time: 0.159764 Jun 07 13:19:02.450914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 403/798] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:02 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:02.641240 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:02.641864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:02.648612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.649099 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.649909 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:02.650524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:02.745245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:02.755274 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-983cc2b7-dae3-426d-bdd1-28ee1e00b56d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1312 microversion: 2.1 time: 0.118114 Jun 07 13:19:02.765675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 396/799] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:02 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:03.456898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3a5a2bbb-fa11-42f5-afd3-0beb30e72f8b req-2b083c62-7fb1-4f77-bf45-3da71b22ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5202ff0-c8c1-4c4f-a89c-f536f724298f", "name": "network-vif-deleted", "tag": "749be2dc-b22c-4710-8386-8d454b1b5992"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:03.470507 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3a5a2bbb-fa11-42f5-afd3-0beb30e72f8b req-2b083c62-7fb1-4f77-bf45-3da71b22ff95 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.470675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:03.470952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3a5a2bbb-fa11-42f5-afd3-0beb30e72f8b req-2b083c62-7fb1-4f77-bf45-3da71b22ff95 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.471169 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:03.482640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.483088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.483883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.484328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.504572 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3a5a2bbb-fa11-42f5-afd3-0beb30e72f8b req-2b083c62-7fb1-4f77-bf45-3da71b22ff95 service nova] Creating event network-vif-deleted:749be2dc-b22c-4710-8386-8d454b1b5992 for instance d5202ff0-c8c1-4c4f-a89c-f536f724298f on hv-cinder-84496 Jun 07 13:19:03.514552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3a5a2bbb-fa11-42f5-afd3-0beb30e72f8b req-2b083c62-7fb1-4f77-bf45-3da71b22ff95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061378 Jun 07 13:19:03.517508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 404/800] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:03.608465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:03.637472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-51ccee40-1703-47f9-b0b1-22bd56798b4c tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 200 len: 1606 microversion: 2.1 time: 0.172873 Jun 07 13:19:03.650475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 397/801] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:03 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 1606 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:19:03.773990 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:03.775395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:03.785090 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.785615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:03.787421 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:03.788123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.323296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:04.332244 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-73e1079a-3ef4-475a-b589-f2fe0062c01e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.562968 Jun 07 13:19:04.351784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 405/802] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:03 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:04.364709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-39a09488-c0b9-4481-93cc-ca2d6ae956bc req-e7a856a3-8455-4c82-9722-8998159a0921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5f1573-0c99-4a11-a312-4736459f884e", "tag": "84dfabf1-b526-43a9-a66a-269225470295"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:04.391531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-39a09488-c0b9-4481-93cc-ca2d6ae956bc req-e7a856a3-8455-4c82-9722-8998159a0921 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.393108 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-39a09488-c0b9-4481-93cc-ca2d6ae956bc req-e7a856a3-8455-4c82-9722-8998159a0921 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.418631 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-39a09488-c0b9-4481-93cc-ca2d6ae956bc req-e7a856a3-8455-4c82-9722-8998159a0921 service nova] Creating event network-changed:84dfabf1-b526-43a9-a66a-269225470295 for instance ff5f1573-0c99-4a11-a312-4736459f884e on hv-cinder-84496 Jun 07 13:19:04.423526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-39a09488-c0b9-4481-93cc-ca2d6ae956bc req-e7a856a3-8455-4c82-9722-8998159a0921 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062833 Jun 07 13:19:04.424144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 398/803] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:04.655523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:04.656288 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:04.663768 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.664483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.666347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:04.667135 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:04.683902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f HTTP/1.1 Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:19:04.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:19:04.687321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd5202ff0-c8c1-4c4f-a89c-f536f724298f'} Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:04.688262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:19:04.690333 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:19:04.692427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:04.692427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-64a4ad09-52ed-4f24-901f-0e5d71f8124d tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 404 len: 111 microversion: 2.1 time: 0.038692 Jun 07 13:19:04.692427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 406/804] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:04 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:19:04.701798 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-906ed72a-2169-4986-ab52-cea2e2f01c25 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '.version_select at 0x7f20a48333a0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:04.722671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-906ed72a-2169-4986-ab52-cea2e2f01c25 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417849956" status: 202 len: 0 microversion: 2.1 time: 0.025864 Jun 07 13:19:04.723364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 399/805] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jun 7 13:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417849956 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:19:05.352054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:05.352676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:05.359312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.359894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.360666 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:05.361128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:05.439947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-260f7b56-5d87-461b-85fe-2bb4877f4c50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: .version_select at 0x7f20a47e2280>, body: {"keypair": {"name": "tempest-keypair-993722588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnjGAn3iGx8j/fejBUObQy5rx8wKErbN5TqXhRHZpmWtmKQ0AY1EwlUVW2Qwl8qb5Zc7oL+CblN5KMjxGsvxYQ/STZhEFtqaHRA4OHxvY8EJ6KPHNatIrkkszy00RMS2g=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:05.455172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-260f7b56-5d87-461b-85fe-2bb4877f4c50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:05.458968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-260f7b56-5d87-461b-85fe-2bb4877f4c50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for user e1e6349a50ec4554b27b94b3f0f2dcbd and project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:05.481544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-260f7b56-5d87-461b-85fe-2bb4877f4c50 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045461 Jun 07 13:19:05.482435 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 400/806] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:19:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:05.494659 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:05.502519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dba08400-e9f1-4557-9259-72009b15c22b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.156265 Jun 07 13:19:05.503194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 407/807] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:05 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:06.519988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:06.520749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:06.527337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.527710 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.528474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:06.528901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:06.661535 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:06.671125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7fbae9ad-f557-460e-9c7d-8903c42c9bf5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.155547 Jun 07 13:19:06.671708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 401/808] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:06 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:06.853609 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1268450750", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f4d412-adf4-49aa-8722-e058a81a2829"}], "security_groups": [{"name": "tempest-securitygroup--639629540"}], "key_name": "tempest-keypair-993722588", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:06.965642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] validate_networks() for [('b4f4d412-adf4-49aa-8722-e058a81a2829', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:07.354673 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:07.355069 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:07.355535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:07.355937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:07.356398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:07.365868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.366310 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.367098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.367510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.384736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:07.389100 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Getting quotas for user e1e6349a50ec4554b27b94b3f0f2dcbd and project 63d29a15ba1f484fbd98c93d98b42c7e. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:07.400091 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:07.402406 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:07.448932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-27421268-a40f-4189-8452-3b3e30f477dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599639 Jun 07 13:19:07.449814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 408/809] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:19:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:19:07.459494 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d17b883b-daa5-4533-99e3-21fce38c24d1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:07.460097 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d17b883b-daa5-4533-99e3-21fce38c24d1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:07.571144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d17b883b-daa5-4533-99e3-21fce38c24d1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:07.579444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d17b883b-daa5-4533-99e3-21fce38c24d1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1237 microversion: 2.1 time: 0.123625 Jun 07 13:19:07.580056 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 402/810] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:07 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:07.688538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:07.689350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:07.696398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.696852 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.697706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:07.698296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:07.848956 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:07.857952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f24ebb15-71ed-4d65-8e00-3cdae8101813 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.173302 Jun 07 13:19:07.858632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 409/811] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:07 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:08.596977 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:08.598290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:08.616797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.617914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.619138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.619837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.699569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:08.707223 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-defa3ec8-5353-41a1-acab-724f69b2a2ee tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1307 microversion: 2.1 time: 0.114178 Jun 07 13:19:08.707876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 403/812] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:08 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:08.876913 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:08.877689 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:08.885264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.886118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:08.886896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:08.887335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:09.020911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.028727 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc9361c9-5ce1-4315-ae75-accb631413e4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.156182 Jun 07 13:19:09.029400 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 410/813] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:08 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:09.724057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:09.724837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:09.731737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:09.732171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:09.732956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:09.733434 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:09.962343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:09.978395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d89a2a64-fda1-45f9-bde5-2143d8b60a47 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.258082 Jun 07 13:19:09.988821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 404/814] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:09 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:10.046386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:10.047261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:10.055806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.056537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.057692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.058373 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.072188 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7dfe9d9b-164b-40ef-808d-f4f84ada6ae0 req-bf39ee72-7f81-4a79-9524-ce183d2072bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5f1573-0c99-4a11-a312-4736459f884e", "name": "network-vif-plugged", "status": "completed", "tag": "84dfabf1-b526-43a9-a66a-269225470295"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:10.084784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7dfe9d9b-164b-40ef-808d-f4f84ada6ae0 req-bf39ee72-7f81-4a79-9524-ce183d2072bd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.085258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7dfe9d9b-164b-40ef-808d-f4f84ada6ae0 req-bf39ee72-7f81-4a79-9524-ce183d2072bd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.106133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7dfe9d9b-164b-40ef-808d-f4f84ada6ae0 req-bf39ee72-7f81-4a79-9524-ce183d2072bd service nova] Creating event network-vif-plugged:84dfabf1-b526-43a9-a66a-269225470295 for instance ff5f1573-0c99-4a11-a312-4736459f884e on hv-cinder-84496 Jun 07 13:19:10.112929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7dfe9d9b-164b-40ef-808d-f4f84ada6ae0 req-bf39ee72-7f81-4a79-9524-ce183d2072bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044334 Jun 07 13:19:10.114411 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 405/815] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:10.194784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-d3df4166-739a-47f2-8add-c46e599cef7a req-ea84e2c6-2879-41a5-bb40-55944e4a6660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d0a196-b7cb-4a84-8f34-ea0eb83529ac", "tag": "d73f4a62-e421-4259-8eb1-a68ee1369493"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:10.214137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d3df4166-739a-47f2-8add-c46e599cef7a req-ea84e2c6-2879-41a5-bb40-55944e4a6660 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:10.214584 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d3df4166-739a-47f2-8add-c46e599cef7a req-ea84e2c6-2879-41a5-bb40-55944e4a6660 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:10.254278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-d3df4166-739a-47f2-8add-c46e599cef7a req-ea84e2c6-2879-41a5-bb40-55944e4a6660 service nova] Creating event network-changed:d73f4a62-e421-4259-8eb1-a68ee1369493 for instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac on hv-cinder-84496 Jun 07 13:19:10.260639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-d3df4166-739a-47f2-8add-c46e599cef7a req-ea84e2c6-2879-41a5-bb40-55944e4a6660 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069694 Jun 07 13:19:10.267716 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 406/816] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:10.300449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:10.312278 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37d2deaf-9250-40ce-b37f-187081246ab7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.269687 Jun 07 13:19:10.313080 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 411/817] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:10 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:11.002075 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:11.002778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:11.012095 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.012523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.013365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.013805 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.165452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.176695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b672ced1-f6b4-4e26-a8b8-77b731d5a330 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.183065 Jun 07 13:19:11.177306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 407/818] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:10 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:11.332566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:11.333463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:11.341955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.342398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.343167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:11.343599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:11.489059 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:11.497344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c9aef825-d89e-4b53-8184-6242bfcf897d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.171419 Jun 07 13:19:11.497913 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 412/819] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:11 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:12.199094 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:12.200103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:12.211017 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.211752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.213054 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.215956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.354477 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.362045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fa447f78-44c0-42b8-b63b-47419ac5c9c2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.169753 Jun 07 13:19:12.362620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 408/820] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:12 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:12.515628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:12.516182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:12.522517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.522965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.523725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:12.524160 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:12.662053 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:12.671545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a1b722d1-e274-4f10-b58a-c9d114d762d9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.160456 Jun 07 13:19:12.672120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 413/821] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:12 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:13.383643 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:13.384613 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:13.392049 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.392493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.393298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.393727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.531668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:13.539193 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-217a424c-d2ca-4dfb-8dfa-d78c243c48f4 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.162114 Jun 07 13:19:13.539756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 409/822] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:13 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:13.701660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:13.702602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:13.712437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.713230 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.714477 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:13.714914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:13.848060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:13.855761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-635efc0b-7170-427a-b65e-6b12b24f0a39 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1367 microversion: 2.1 time: 0.163602 Jun 07 13:19:13.856328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 414/823] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:13 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:14.556212 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:14.556830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:14.564447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.565414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:14.565727 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.566161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:14.714867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:14.723648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a57409ca-23d1-4eac-8f47-7c9d4c0054d7 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.171113 Jun 07 13:19:14.724438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 410/824] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:14 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:14.876573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:14.878621 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:14.888713 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.889184 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:14.889929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:14.890370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.036103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.048267 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5473cc86-df64-4922-aacf-c08d978c84c2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1557 microversion: 2.1 time: 0.178094 Jun 07 13:19:15.049114 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 415/825] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:14 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:15.068669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:15.069167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:15.075465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.075916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.076680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.077150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.160546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-488fd768-a23d-4ccf-8cf9-fad65679dde4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095444 Jun 07 13:19:15.161417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 411/826] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:19:15 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:15.740043 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:15.740645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:15.747498 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.747951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.748710 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:15.749201 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:15.879898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:15.888063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6d7f31cf-ffcc-45a9-830d-354861e471ea tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.152004 Jun 07 13:19:15.888792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 416/827] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:15 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:16.063966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-38233c86-b47d-4f48-9936-90561e51b89e req-5b76fa2e-9f7d-48a3-8e6a-497a695a0081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d0a196-b7cb-4a84-8f34-ea0eb83529ac", "name": "network-vif-plugged", "status": "completed", "tag": "d73f4a62-e421-4259-8eb1-a68ee1369493"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:16.074546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-38233c86-b47d-4f48-9936-90561e51b89e req-5b76fa2e-9f7d-48a3-8e6a-497a695a0081 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.075251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-38233c86-b47d-4f48-9936-90561e51b89e req-5b76fa2e-9f7d-48a3-8e6a-497a695a0081 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.090705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-38233c86-b47d-4f48-9936-90561e51b89e req-5b76fa2e-9f7d-48a3-8e6a-497a695a0081 service nova] Creating event network-vif-plugged:d73f4a62-e421-4259-8eb1-a68ee1369493 for instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac on hv-cinder-84496 Jun 07 13:19:16.097311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-38233c86-b47d-4f48-9936-90561e51b89e req-5b76fa2e-9f7d-48a3-8e6a-497a695a0081 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Jun 07 13:19:16.098397 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 412/828] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:16.128511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-7a15e350-64be-42fb-920c-68ca8988416e req-59cee32f-ced7-4263-bd30-b63abb37855e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5f1573-0c99-4a11-a312-4736459f884e", "tag": "84dfabf1-b526-43a9-a66a-269225470295"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:16.145960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7a15e350-64be-42fb-920c-68ca8988416e req-59cee32f-ced7-4263-bd30-b63abb37855e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.146514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-7a15e350-64be-42fb-920c-68ca8988416e req-59cee32f-ced7-4263-bd30-b63abb37855e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.158766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-7a15e350-64be-42fb-920c-68ca8988416e req-59cee32f-ced7-4263-bd30-b63abb37855e service nova] Creating event network-changed:84dfabf1-b526-43a9-a66a-269225470295 for instance ff5f1573-0c99-4a11-a312-4736459f884e on hv-cinder-84496 Jun 07 13:19:16.165062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-7a15e350-64be-42fb-920c-68ca8988416e req-59cee32f-ced7-4263-bd30-b63abb37855e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040192 Jun 07 13:19:16.165683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 417/829] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:16.906026 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:16.906757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:16.914393 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.914840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:16.915641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:16.916146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:17.069549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:17.078316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-503733d1-24b6-466f-842c-2c90021ab42a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1362 microversion: 2.1 time: 0.176723 Jun 07 13:19:17.078907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 413/830] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:16 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:18.095492 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=4 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:18.096170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=12 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:18.101159 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:18.102418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:18.110542 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.110985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.111741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.112171 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.247872 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:18.255785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0411b7af-d7c6-461a-9b01-1388e8b48223 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1547 microversion: 2.1 time: 0.162859 Jun 07 13:19:18.256356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 418/831] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:18 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:18.272554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:18.274126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:18.277192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=12 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:18.283623 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.284071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.284827 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:18.285310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:18.375174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-42485b3a-3060-493f-9c31-4c3151cf4b0b tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106206 Jun 07 13:19:18.376202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 414/832] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:19:18 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:19.643835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-efd566ae-f344-477a-808b-b4d07b01bd0a req-1803c711-4f90-4957-aa88-a31d06b228b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d0a196-b7cb-4a84-8f34-ea0eb83529ac", "tag": "d73f4a62-e421-4259-8eb1-a68ee1369493"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:19.652910 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-efd566ae-f344-477a-808b-b4d07b01bd0a req-1803c711-4f90-4957-aa88-a31d06b228b4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:19.653392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-efd566ae-f344-477a-808b-b4d07b01bd0a req-1803c711-4f90-4957-aa88-a31d06b228b4 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:19.664839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-efd566ae-f344-477a-808b-b4d07b01bd0a req-1803c711-4f90-4957-aa88-a31d06b228b4 service nova] Creating event network-changed:d73f4a62-e421-4259-8eb1-a68ee1369493 for instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac on hv-cinder-84496 Jun 07 13:19:19.670263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-efd566ae-f344-477a-808b-b4d07b01bd0a req-1803c711-4f90-4957-aa88-a31d06b228b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030449 Jun 07 13:19:19.670921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 419/833] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:35.193425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:35.194718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:35.201036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.201537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.209788 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.210224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.211113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.211584 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.239373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:19:35.326346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-785b3c83-80ba-4d22-86b9-4afad5d994fb tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 204 len: 0 microversion: 2.1 time: 0.135233 Jun 07 13:19:35.330523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 415/834] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:19:35 2022] DELETE /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:35.334176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:35.334933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=96 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:35.339335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:35.340068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:35.347603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.348051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.348811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:35.349271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:35.489571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:35.498261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37c50af0-1157-4a46-b1f6-c2ec7a3a2fa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1577 microversion: 2.1 time: 0.165869 Jun 07 13:19:35.498829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 420/835] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:35 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:36.524849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:36.526022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:36.533582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.534034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.534804 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:36.535262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:36.698082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:36.706461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-aef0d187-a320-4e5b-ab4f-5b0c3e58ed8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1577 microversion: 2.1 time: 0.188833 Jun 07 13:19:36.707020 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 416/836] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:36 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:37.724084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:37.724649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:37.731657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.732108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.732863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:37.733324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:37.796677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:37.804296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d42d9b37-9850-41b4-b61f-a1b0d2ad3249 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1510 microversion: 2.1 time: 0.084248 Jun 07 13:19:37.805376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 421/837] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:37 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:38.108730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-98145feb-fde0-4958-a2dc-825c11cb7fcd req-a17c7e60-0d79-419b-8d9a-ae6ba07c4b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f08c6a-dd16-4928-a462-8c396f9608a6", "name": "network-vif-deleted", "tag": "b2917f80-dcb9-4be9-8700-b022a43d153c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:38.118701 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-98145feb-fde0-4958-a2dc-825c11cb7fcd req-a17c7e60-0d79-419b-8d9a-ae6ba07c4b1a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.119138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-98145feb-fde0-4958-a2dc-825c11cb7fcd req-a17c7e60-0d79-419b-8d9a-ae6ba07c4b1a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.132316 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-98145feb-fde0-4958-a2dc-825c11cb7fcd req-a17c7e60-0d79-419b-8d9a-ae6ba07c4b1a service nova] Creating event network-vif-deleted:b2917f80-dcb9-4be9-8700-b022a43d153c for instance a6f08c6a-dd16-4928-a462-8c396f9608a6 on hv-cinder-84496 Jun 07 13:19:38.137739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-98145feb-fde0-4958-a2dc-825c11cb7fcd req-a17c7e60-0d79-419b-8d9a-ae6ba07c4b1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033109 Jun 07 13:19:38.141814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 417/838] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:38.825691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:38.827820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:38.838054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.838792 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.840223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.841369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.885172 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:38.885639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:38.886099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lazy-loading 'fault' on Instance uuid a6f08c6a-dd16-4928-a462-8c396f9608a6 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:38.931845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:38.940071 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-64d5ba0c-e23f-4af2-a3e4-c33d6f87e00f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 200 len: 1229 microversion: 2.1 time: 0.121043 Jun 07 13:19:38.947652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 422/839] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:38 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 1229 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:39.963612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:39.964645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:39.975216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.975939 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.977158 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:39.977833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:39.993490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] HTTP exception thrown: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Request method failure captured: Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 HTTP/1.1 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin0-PzwFrCXcRouic7lNq2oAM6X5m5_D8iECMoVrnGgb3mhcirdZCny7cbjT1J5RbYMc3t2K5nxBOg7LSL53dxp49iTNTL6P0FGyJ99s_jJYekmsOYDGemF_91dprNz-kS8zPbb81LzgA4gUrPe1gQCg94CyZVcgWsOmL3g53CnqeYUY Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:19:39.995180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03491cee113744268fc89b63330c21c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03491cee113744268fc89b63330c21c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 43f9e7923ebb4939ac2bd590270b48d7 Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:19:39.997406 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'a6f08c6a-dd16-4928-a462-8c396f9608a6'} Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:19:39.998912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:19:40.000761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:19:40.003003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Returning 404 to user: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:19:40.003003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1f8c7caf-a91b-495f-b531-bab670a6f19f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 404 len: 111 microversion: 2.1 time: 0.041201 Jun 07 13:19:40.003003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 418/840] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:39 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:19:40.095340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-748006159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624960488", "security_groups": [{"name": "tempest-secgroup-smoke-813133215"}], "block_device_mapping_v2": [{"uuid": "caaf9227-f850-4194-b6a8-8c9f173f8b00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d3913f7-d82f-4020-8fba-805cb52d0d5c"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:40.209849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] validate_networks() for [('8d3913f7-d82f-4020-8fba-805cb52d0d5c', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:19:40.597369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:19:40.597793 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:19:40.598261 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:19:40.598665 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:19:40.599077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:19:40.609465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.609906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.610700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:40.611636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:40.629653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:19:40.633684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for user 43f9e7923ebb4939ac2bd590270b48d7 and project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:19:40.689677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:19:40.691791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='caaf9227-f850-4194-b6a8-8c9f173f8b00',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:19:40.835073 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-37ddef64-be2c-4281-aaa5-0ca2f22d7924 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.743465 Jun 07 13:19:40.835709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 423/841] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:19:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:19:40.846099 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2541177-339e-4c05-bc1d-8f5687c46632 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:40.846636 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f2541177-339e-4c05-bc1d-8f5687c46632 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:40.905993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f2541177-339e-4c05-bc1d-8f5687c46632 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:40.911679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2541177-339e-4c05-bc1d-8f5687c46632 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1093 microversion: 2.1 time: 0.069550 Jun 07 13:19:40.912237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 419/842] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:40 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:41.931875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:41.932619 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:41.939994 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.940442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:41.941289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:41.941724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:42.009152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:42.016909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31a4e0b5-cec4-4ea5-82c5-cee0b536abfd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1209 microversion: 2.1 time: 0.088942 Jun 07 13:19:42.018016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 424/843] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:41 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.034726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:43.035431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:43.043931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.044367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.045314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.045715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.253839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:43.261583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a613a2d7-1da8-4246-9db4-75e9e8487e05 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.230986 Jun 07 13:19:43.262290 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 420/844] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:43 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:43.390516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-c39ed22a-6fed-4292-b5a6-2580d2f68b7d req-d5c4b433-be54-47b8-a402-692225ef01d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c76284-90fa-4dc0-a1a9-bc3285a60efe", "tag": "22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:43.399331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c39ed22a-6fed-4292-b5a6-2580d2f68b7d req-d5c4b433-be54-47b8-a402-692225ef01d0 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:43.399746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-c39ed22a-6fed-4292-b5a6-2580d2f68b7d req-d5c4b433-be54-47b8-a402-692225ef01d0 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:43.411774 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-c39ed22a-6fed-4292-b5a6-2580d2f68b7d req-d5c4b433-be54-47b8-a402-692225ef01d0 service nova] Creating event network-changed:22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd for instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe on hv-cinder-84496 Jun 07 13:19:43.417115 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-c39ed22a-6fed-4292-b5a6-2580d2f68b7d req-d5c4b433-be54-47b8-a402-692225ef01d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030430 Jun 07 13:19:43.417703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 425/845] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:44.283904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:44.284940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:44.301055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.301676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.302696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:44.303273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:44.446639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:44.456228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8b457806-9d46-4562-9ff3-d2fa6aaf3878 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.179767 Jun 07 13:19:44.456847 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 421/846] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:44 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:45.475183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:45.475859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:45.483448 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.483912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.484730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:45.485183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:45.627182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:45.634896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b61ee618-8db9-4a6d-ae89-77dc01deb2b0 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.165084 Jun 07 13:19:45.635463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 426/847] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:45 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:46.652529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:46.653197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:46.661057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.661498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.662332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:46.662821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:46.803403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:46.813747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5f03ea23-bb2a-43cb-a8b9-f9b8ea61e586 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.165700 Jun 07 13:19:46.814301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 422/848] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:46 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:47.832858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:47.833577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:47.842593 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.843247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.844359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:47.844999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:47.982347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:47.990177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da1d498f-7fb1-4d55-850d-9647d5b3c6e6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.162507 Jun 07 13:19:47.990716 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 427/849] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:47 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:49.011744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:49.012700 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:49.024173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.024931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.026255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:49.026998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:49.180965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:49.188698 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8b261f89-b2d5-4f7e-9bf4-44046e21f8c3 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.183643 Jun 07 13:19:49.189302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 423/850] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:49 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:50.206934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:50.207572 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:50.214509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.214961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.215754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:50.216191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:50.360522 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:50.369637 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75c73800-46d6-4a6b-ad0e-459407fdfa45 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.167020 Jun 07 13:19:50.370211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 428/851] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:50 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:51.390372 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:51.391341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:51.395037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:51.404097 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.404830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.406128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:51.406846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:51.546179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:51.554555 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-387aea67-4ede-4b31-91a2-354a64efb98e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.170724 Jun 07 13:19:51.555145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 424/852] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:51 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:52.571890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:52.572500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:52.574646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:52.575529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:19:52.583450 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.583902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.584652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:52.585334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:52.730035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:52.738894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6823bacf-9839-422d-8118-caf01a2ca4c6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.170856 Jun 07 13:19:52.739483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 429/853] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:52 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:53.321449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.323212 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.333278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.333736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.334512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.334947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.357847 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-827c576f-d677-4df5-80c8-5cab7f2759f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/ips" status: 200 len: 151 microversion: 2.20 time: 0.042571 Jun 07 13:19:53.358435 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 425/854] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:19:53.756248 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:53.756805 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:53.763551 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.764000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.764764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:53.765230 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:53.908553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:53.916821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-988ec5c7-fd87-4cec-8b6c-2f181c4b7ac9 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.164804 Jun 07 13:19:53.917438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 430/855] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:53 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:54.167679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-8a647434-02bf-471a-9384-dfea03c75905 req-7edf7954-a673-48f1-858a-f8e9f6ed06b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c76284-90fa-4dc0-a1a9-bc3285a60efe", "name": "network-vif-plugged", "status": "completed", "tag": "22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:54.176207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8a647434-02bf-471a-9384-dfea03c75905 req-7edf7954-a673-48f1-858a-f8e9f6ed06b1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.176648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-8a647434-02bf-471a-9384-dfea03c75905 req-7edf7954-a673-48f1-858a-f8e9f6ed06b1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.188305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-8a647434-02bf-471a-9384-dfea03c75905 req-7edf7954-a673-48f1-858a-f8e9f6ed06b1 service nova] Creating event network-vif-plugged:22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd for instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe on hv-cinder-84496 Jun 07 13:19:54.193603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-8a647434-02bf-471a-9384-dfea03c75905 req-7edf7954-a673-48f1-858a-f8e9f6ed06b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029634 Jun 07 13:19:54.194237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 426/856] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:19:54.940300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:54.941043 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:54.949777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.950334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:54.951280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:54.951818 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.092153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.103782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-806c2665-51e7-4557-84e8-caadb0517877 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1264 microversion: 2.1 time: 0.168035 Jun 07 13:19:55.104479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 431/857] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:54 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:55.224859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:55.225420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.232311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.232752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.233540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.233968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.257505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lazy-loading 'flavor' on Instance uuid d341eab7-1862-4ff7-ae50-991185475a8f {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:19:55.539706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19857eb8-fe1c-4b28-ac35-fbee5dd6c848 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/action" status: 202 len: 0 microversion: 2.20 time: 0.320288 Jun 07 13:19:55.540331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 427/858] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jun 7 13:19:55 2022] POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:19:55.548845 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:55.549487 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:55.556693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.557174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.557940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:55.558378 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:55.700605 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.711085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.712561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:55.713735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-920350be-18db-44e8-a066-e6871a70a2f8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.168994 Jun 07 13:19:55.714334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 432/859] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:55 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:56.121364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.122047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.129161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.129588 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.130348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.130772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.272105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.280073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7de32c2f-5d6e-4a91-a81a-7792dc86b28d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1451 microversion: 2.1 time: 0.163801 Jun 07 13:19:56.280641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 428/860] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.296906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.297502 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.304672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.305254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.306042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.306478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.446292 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.454338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bebb7dbd-2ac8-451c-9b1f-9927dcefca1a tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1451 microversion: 2.1 time: 0.161359 Jun 07 13:19:56.454902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 433/861] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:19:56.733572 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:56.734131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:56.740273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.740707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.741512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:56.742079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:56.950467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.958880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.960483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:56.961874 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fb7422d8-3571-494c-8946-151f035d1fbc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.232485 Jun 07 13:19:56.962421 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 429/862] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:56 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:57.981786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:57.982349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:57.990224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.990678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:57.991449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:57.992018 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.123812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.133167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.134670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:58.135853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0f782e45-e8bd-4245-9abb-60e6219274d3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.158231 Jun 07 13:19:58.136420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 434/863] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:57 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:19:58.235932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-63c9fbd7-4d29-452b-922e-3197620422bb req-f371a0d0-cc2c-4da1-b06e-eae523fbc116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c76284-90fa-4dc0-a1a9-bc3285a60efe", "tag": "22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:19:58.244929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-63c9fbd7-4d29-452b-922e-3197620422bb req-f371a0d0-cc2c-4da1-b06e-eae523fbc116 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:58.245408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-63c9fbd7-4d29-452b-922e-3197620422bb req-f371a0d0-cc2c-4da1-b06e-eae523fbc116 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:58.256824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-63c9fbd7-4d29-452b-922e-3197620422bb req-f371a0d0-cc2c-4da1-b06e-eae523fbc116 service nova] Creating event network-changed:22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd for instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe on hv-cinder-84496 Jun 07 13:19:58.262141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-63c9fbd7-4d29-452b-922e-3197620422bb req-f371a0d0-cc2c-4da1-b06e-eae523fbc116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030077 Jun 07 13:19:58.262962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 430/864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:19:59.155914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:19:59.156495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:19:59.166265 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.167104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.168544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:19:59.169117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:19:59.328574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.342022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.344657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:19:59.346556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6a9ad74b-c1bc-4766-982a-30684f7a28cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.195277 Jun 07 13:19:59.347455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 435/865] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:19:59 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:00.377600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:00.378245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:00.386279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.386873 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.387668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:00.388114 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:00.638155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.641840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:00.647067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.650883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:00.652076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e368f733-da03-4ce1-880f-f11ec489a47e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.280754 Jun 07 13:20:00.652625 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 431/866] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:00 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:01.670461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.671068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.678938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.679900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.680890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.681537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.684130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.684901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.693386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.693926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.694879 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.695604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.724527 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:20:01.822845 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ff576443-6ea3-4087-9495-ae378f0116a5 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 204 len: 0 microversion: 2.1 time: 0.143039 Jun 07 13:20:01.824416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 432/867] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:20:01 2022] DELETE /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:20:01.830249 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-f14205e9-d87f-46a2-9f51-21729967d514 req-6090ddda-bf96-441f-b7c9-8482d6120088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:01.839464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f14205e9-d87f-46a2-9f51-21729967d514 req-6090ddda-bf96-441f-b7c9-8482d6120088 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.839724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-f14205e9-d87f-46a2-9f51-21729967d514 req-6090ddda-bf96-441f-b7c9-8482d6120088 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.841822 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.849992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.851560 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:01.852737 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-581484e9-0908-4a57-82c4-531100dda4b0 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.186239 Jun 07 13:20:01.853336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 436/868] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:01.853472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-f14205e9-d87f-46a2-9f51-21729967d514 req-6090ddda-bf96-441f-b7c9-8482d6120088 service nova] Creating event network-changed:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:20:01.858087 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:01.858887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:01.865150 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.865664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.865858 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-f14205e9-d87f-46a2-9f51-21729967d514 req-6090ddda-bf96-441f-b7c9-8482d6120088 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039703 Jun 07 13:20:01.866556 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 433/869] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:01.869731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:01.870249 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:01.890608 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=100 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:02.012247 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:02.020166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aef07bd5-5e81-40e5-be89-594cd99f814c tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.165483 Jun 07 13:20:02.021214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 437/870] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:01 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:02.873105 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:02.873962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:02.880702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.881166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:02.881896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:02.882614 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.023771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.032737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.035991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.039389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-703521f3-2303-459a-8376-ab7abac1bee2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.170907 Jun 07 13:20:03.040196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 434/871] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:02 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:03.040338 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:03.041035 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:03.048853 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.049639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.050494 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:03.051016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:03.194001 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:03.202435 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7861fae-8e6f-4027-8d08-a12b74ef695a tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1569 microversion: 2.1 time: 0.167722 Jun 07 13:20:03.203023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 438/872] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:03 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:04.058213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.066447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.074474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.074946 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.075762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.076184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.128930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-cbc63ae4-cd22-4026-83ff-b803eaa328bd req-d94d4633-f897-4f49-8453-368ca52cc9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85f110d-e60a-4075-bba8-a1a9dd548b18", "name": "network-vif-deleted", "tag": "892b379f-ebdf-47d7-bce2-ec9334708ead"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:04.142388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cbc63ae4-cd22-4026-83ff-b803eaa328bd req-d94d4633-f897-4f49-8453-368ca52cc9ec service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.146704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-cbc63ae4-cd22-4026-83ff-b803eaa328bd req-d94d4633-f897-4f49-8453-368ca52cc9ec service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.170895 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-cbc63ae4-cd22-4026-83ff-b803eaa328bd req-d94d4633-f897-4f49-8453-368ca52cc9ec service nova] Creating event network-vif-deleted:892b379f-ebdf-47d7-bce2-ec9334708ead for instance b85f110d-e60a-4075-bba8-a1a9dd548b18 on hv-cinder-84496 Jun 07 13:20:04.175992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-cbc63ae4-cd22-4026-83ff-b803eaa328bd req-d94d4633-f897-4f49-8453-368ca52cc9ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050683 Jun 07 13:20:04.176610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 439/873] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:04.221485 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:04.222573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:04.229165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.229612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.230447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:04.230947 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:04.256299 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.265163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.266649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.267812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a2fdc6f2-daf0-4d2b-b9ab-22663397463e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.213767 Jun 07 13:20:04.268366 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 435/874] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:04.302816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75d5fe118b348098ac701778e552da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f471802c1e4d5393928e42b59b2962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:04.310902 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-58be5d1c-d7e8-4c9d-85ab-d9ae65843611 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 200 len: 1219 microversion: 2.1 time: 0.094649 Jun 07 13:20:04.311485 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 440/875] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:04 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:05.291916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.292926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.296776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:05.305384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.305832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.306603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.307041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.327825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.328407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] [instance: b85f110d-e60a-4075-bba8-a1a9dd548b18] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:05.335300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.335797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.336703 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:05.337146 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:05.350934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] HTTP exception thrown: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Request method failure captured: Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 HTTP/1.1 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin076ACvK02b9NK6w0T7W2-uuXsOGv3wdC5tNv-n-0k6YUjRdcSYDCzXKbIzdCE-eCWqeWQk3PekeJgSXytVDY8gSfVAfGf64LpqUDXsdGcTDLvNxZxw3H6dyiQi195De0SBpADJaJcV9JPw0pdtG7GFqc1tlM_NOvllVwKQo4JalqMg Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 01f471802c1e4d5393928e42b59b2962 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestShelveInstance-604943581 Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:20:05.352693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01f471802c1e4d5393928e42b59b2962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01f471802c1e4d5393928e42b59b2962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01f471802c1e4d5393928e42b59b2962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01f471802c1e4d5393928e42b59b2962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestShelveInstance-604943581 Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 01f471802c1e4d5393928e42b59b2962 Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestShelveInstance-604943581 Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-TestShelveInstance-604943581-project Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: f75d5fe118b348098ac701778e552da7 Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestShelveInstance-604943581-project Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. Jun 07 13:20:05.354127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'b85f110d-e60a-4075-bba8-a1a9dd548b18'} Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:20:05.354950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. Jun 07 13:20:05.356286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:20:05.357626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Returning 404 to user: Instance b85f110d-e60a-4075-bba8-a1a9dd548b18 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:20:05.357626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-90c284b0-586b-4e6b-be30-503f96f080d3 tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18" status: 404 len: 111 microversion: 2.1 time: 0.030176 Jun 07 13:20:05.357626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 441/876] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/b85f110d-e60a-4075-bba8-a1a9dd548b18 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:20:05.444997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.454862 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.456347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:05.457549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dd5f2b82-db04-45a8-ae61-d1c1928c771d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.172631 Jun 07 13:20:05.458118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 436/877] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:05 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:05.524854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11107ab7-6086-4432-a1f3-5fb33010de2e tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] Calling method '.version_select at 0x7f20a47ef040>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:05.531058 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:05.546814 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11107ab7-6086-4432-a1f3-5fb33010de2e tempest-TestShelveInstance-604943581 tempest-TestShelveInstance-604943581-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-753366998" status: 202 len: 0 microversion: 2.1 time: 0.026291 Jun 07 13:20:05.547701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 442/878] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jun 7 13:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-753366998 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:20:06.475945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:06.476808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:06.483373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.483834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.484606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:06.485066 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:06.738537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.750702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.753129 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:06.754821 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-01d6312b-e560-461b-b564-4352a7ec523e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.282642 Jun 07 13:20:06.755657 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 437/879] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:06 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:07.773862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:07.774489 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:07.781479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.781926 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:07.782697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:07.783163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:08.262459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.271345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.272954 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:08.274170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7512bba2-fe2b-4d04-9e33-52bfbd56f63a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.504539 Jun 07 13:20:08.274731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 443/880] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:07 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:09.293628 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:09.294219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:09.300771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.301247 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.302026 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:09.302644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:09.507134 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.516850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.518439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:09.519619 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c64a775e-7903-45fc-8fb5-26a1f715037e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.231391 Jun 07 13:20:09.520199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 438/881] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:09 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:10.538565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:10.539736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:10.547365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.548023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.548645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:10.549077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:10.710066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.722211 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.724430 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:10.728534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-11f18ffb-4811-4539-b5a0-2642c584bd5a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.193871 Jun 07 13:20:10.729682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 444/882] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:10 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:11.749419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:11.750175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:11.758461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.758987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.759839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:11.760285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:11.932235 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.940361 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.942456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:11.943653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a3c6ea90-f0c6-41ed-a6c7-f7ce7ee106af tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.198226 Jun 07 13:20:11.944557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 439/883] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:11 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:12.962401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:12.963124 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:12.969988 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.970625 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:12.971467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:12.971975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:13.155486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:13.170025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:13.171758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:13.173683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e86ef1ec-b5f3-4515-9a0f-493cafaa735d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1744 microversion: 2.20 time: 0.215696 Jun 07 13:20:13.184809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 445/884] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:12 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:14.193253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:14.193817 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:14.201460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.201901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.202678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.203112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.260086 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-61ca7144-6481-4fdc-9f0b-ea7a1ad246d9 req-057550e6-3291-465c-b8c2-5f6766eeddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "name": "network-vif-plugged", "status": "completed", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:14.269268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-61ca7144-6481-4fdc-9f0b-ea7a1ad246d9 req-057550e6-3291-465c-b8c2-5f6766eeddb1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:14.270192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-61ca7144-6481-4fdc-9f0b-ea7a1ad246d9 req-057550e6-3291-465c-b8c2-5f6766eeddb1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:14.349227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.358044 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.359544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:14.360768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bf965ec5-eeeb-49b7-a6c6-a3ee13997392 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1744 microversion: 2.20 time: 0.172837 Jun 07 13:20:14.361400 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 440/885] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:14 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:14.450175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-61ca7144-6481-4fdc-9f0b-ea7a1ad246d9 req-057550e6-3291-465c-b8c2-5f6766eeddb1 service nova] Creating event network-vif-plugged:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:20:14.455238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-61ca7144-6481-4fdc-9f0b-ea7a1ad246d9 req-057550e6-3291-465c-b8c2-5f6766eeddb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199153 Jun 07 13:20:14.455831 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 446/886] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:15.383171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:15.383837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:15.390737 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.391197 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.391962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:15.392394 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:15.540973 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.549365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.550875 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:15.552080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d1af48cf-68f4-4216-b64e-6e477059f2a8 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1744 microversion: 2.20 time: 0.174890 Jun 07 13:20:15.552866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 441/887] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:15 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:16.574973 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:16.575667 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:16.583534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.584061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.585062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:16.585647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:16.722789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.731668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.733335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:16.734495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-75e9e27b-f0fc-4959-b6b2-df664846fb97 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1744 microversion: 2.20 time: 0.164482 Jun 07 13:20:16.735052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 447/888] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:16 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:17.757241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:17.758263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:17.774273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.774748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.775592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:17.776026 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:17.918846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.927436 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.928921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:17.930102 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a5f281e7-7709-4ecd-bf64-8bb4ef24337c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1744 microversion: 2.20 time: 0.179930 Jun 07 13:20:17.930702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 442/889] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:17 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:18.948015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:18.948770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:18.956078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.956527 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:18.957351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:18.957771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:19.102963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.113374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.115594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:19.117353 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-df88f7fa-2226-4389-9398-c0795e5427ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.173044 Jun 07 13:20:19.118181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 448/890] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:18 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:20.136302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:20.137621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:20.144913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.145659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.146444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:20.146987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:20.307969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:20.318207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:20.320924 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:20.323156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-85b3121e-d944-4d59-b6f4-cea41dad105c tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.191182 Jun 07 13:20:20.323736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 443/891] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:20 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:21.342750 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:21.344264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:21.352222 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.352800 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.354017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:21.354500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:21.518750 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.527517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.529157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:21.530456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2ed4c8e9-32e7-4aa1-b3f1-ef47bd6de726 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.192439 Jun 07 13:20:21.531020 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 449/892] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:21 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:22.550307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:22.550914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:22.560455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.561285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.562078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:22.563144 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:22.730398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.740457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.742603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:22.744558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-07b37ce7-ce07-429a-bd10-825fc5d2742a tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.198859 Jun 07 13:20:22.745398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 444/893] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:22 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:23.767191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:23.769103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:23.778319 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.779032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:23.780051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:23.780536 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:24.001791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:24.013209 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:24.015184 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:24.016377 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cf4dac51-2f6a-4ada-b022-3baca4bc6f8d tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.255024 Jun 07 13:20:24.021109 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 450/894] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:23 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:25.036384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:25.037154 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:25.045037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.045658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.046621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:25.047178 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:25.196280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.206092 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.207822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:25.209097 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5b8c1c0f-a038-4249-b552-9ca28fefb7df tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.177282 Jun 07 13:20:25.217541 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 445/895] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:25 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:26.230918 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:26.232086 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:26.240271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.241061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.242273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:26.242781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:26.412788 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:26.422799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:26.424331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:26.425558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f601b9e7-9fd4-440d-881b-af41ad0893f7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.201320 Jun 07 13:20:26.426610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 451/896] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:26 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:27.452949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:27.454021 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:27.465096 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.465832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.467078 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:27.467766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:27.640326 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.648658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.653514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:27.653514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-28d7ceb1-bf6f-4ace-9fb0-b784f9acff5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.204470 Jun 07 13:20:27.653514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 446/897] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:27 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:28.670376 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:28.670988 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:28.678109 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.678541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:28.679332 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:28.679769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:28.830358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:28.839407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:28.840896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:28.842098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c0f2959-98c5-415a-a68f-1e04acb49a05 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1739 microversion: 2.20 time: 0.175768 Jun 07 13:20:28.842653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 452/898] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:28 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:29.861266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:29.861928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:29.869761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.870210 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.871001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:29.871437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:29.890615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:30.020650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:30.029133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:30.030797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:30.031966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9115f044-d0b3-4d5f-bbd5-d65f9c6e7ada tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1721 microversion: 2.20 time: 0.174761 Jun 07 13:20:30.032529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 447/899] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:29 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:31.051083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.051669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:31.059297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.059759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.060546 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.060989 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.200009 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:31.208781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:31.210343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:31.211478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f49eb4d5-9a00-4512-9cc3-c6bdf969fa3b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1721 microversion: 2.20 time: 0.164509 Jun 07 13:20:31.212118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 453/900] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:31 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:31.232532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:31.233166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:31.240050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.240508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.241330 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:31.242118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:31.267966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-11fff44c-22bc-4482-8028-60934f95b90b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/ips" status: 200 len: 149 microversion: 2.1 time: 0.040177 Jun 07 13:20:31.268551 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 448/901] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:20:31 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:32.231446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:32.232940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.240164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.240701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.242109 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.242695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.247576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=81 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:32.389081 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-6f3bb5f6-725e-4a28-bf4f-a0227d9d8a01 req-87056832-06c4-4dc0-a95c-b88c0e632790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "name": "network-vif-unplugged", "status": "completed", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:32.404825 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6f3bb5f6-725e-4a28-bf4f-a0227d9d8a01 req-87056832-06c4-4dc0-a95c-b88c0e632790 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.405690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-6f3bb5f6-725e-4a28-bf4f-a0227d9d8a01 req-87056832-06c4-4dc0-a95c-b88c0e632790 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.422866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.compute.server_external_events [req-6f3bb5f6-725e-4a28-bf4f-a0227d9d8a01 req-87056832-06c4-4dc0-a95c-b88c0e632790 service nova] Unable to find a host for instance d341eab7-1862-4ff7-ae50-991185475a8f. Dropping event network-vif-unplugged {{(pid=117833) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 13:20:32.423785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-6f3bb5f6-725e-4a28-bf4f-a0227d9d8a01 req-87056832-06c4-4dc0-a95c-b88c0e632790 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043538 Jun 07 13:20:32.424396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 449/902] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 13:20:32.459336 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.470570 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.472097 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:32.473457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-57a40a9c-0e2a-445e-b773-bdd0b7e8a45e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1664 microversion: 2.20 time: 0.247050 Jun 07 13:20:32.474031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 454/903] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:32 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:32.493951 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc4d9b88-8e9e-48ec-983b-ab23575171eb"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:32.495180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.501995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.502487 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.503270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.503713 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.734201 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a77fb1fb-6a43-40a9-9618-fc7b72ca5421"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:32.734885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:32.741523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.742337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.743182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:32.743616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:32.885433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a1181ded-e552-4413-9820-827466d14e5f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396777 Jun 07 13:20:32.886185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 450/904] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jun 7 13:20:32 2022] POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 13:20:33.038823 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:33.039328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.047461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.047914 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.048740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.049243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.079170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-80735672-bc73-4adf-b4be-4fa0bca6a60c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349128 Jun 07 13:20:33.080007 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 455/905] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:20:32 2022] POST /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:33.372855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-29bc6f9b-cc09-403e-9755-38f5994f1c7b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments/bc4d9b88-8e9e-48ec-983b-ab23575171eb" status: 202 len: 0 microversion: 2.20 time: 0.338632 Jun 07 13:20:33.373585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 451/906] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jun 7 13:20:33 2022] DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments/bc4d9b88-8e9e-48ec-983b-ab23575171eb => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:20:33.435342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:33.435977 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.442759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.443260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.443982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.444413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.536861 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-fd694b6a-04c0-45fa-b752-14a6a4ec4d24 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/action" status: 202 len: 0 microversion: 2.20 time: 0.106241 Jun 07 13:20:33.537164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 456/907] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jun 7 13:20:33 2022] POST /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:20:33.546546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:33.547168 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:33.555869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.556390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.557237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:33.558024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:33.751455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.762864 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.765539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:33.766091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c1206ee1-ae33-4ddc-979e-8ef302dceead tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1672 microversion: 2.20 time: 0.224365 Jun 07 13:20:33.767031 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 452/908] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:33 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:34.789005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.789731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.799103 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.799560 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.800855 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.801698 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.889283 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:34.889897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:34.898555 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.899420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.900992 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:34.901815 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:34.941311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7aebf123-b46d-425d-abff-c29854cc363a tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/ips" status: 200 len: 145 microversion: 2.1 time: 0.056486 Jun 07 13:20:34.941925 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 453/909] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:35.063039 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.078017 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.081276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:35.083771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dafec401-4762-4cd3-a286-b2feae221682 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.300985 Jun 07 13:20:35.085101 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 457/910] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:34 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:36.119832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:36.120484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.135367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=36 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:36.144257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.145878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.147397 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.148238 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.375664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.408596 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.413433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:36.421211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-be710a11-39ea-4bfd-a65b-b8c96a266a9e tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.306709 Jun 07 13:20:36.422420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 454/911] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:36 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:36.487684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29290931-de11-4cb9-844d-c345c621c4d7"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:36.488836 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:36.491520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:36.498412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.498837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:36.499851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:36.500295 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.455722 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:37.457126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:37.478152 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.481242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.483418 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:37.483881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:37.697242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.705761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.707427 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:37.708753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-75677b18-eea2-4b67-845d-d89355194ec5 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.263379 Jun 07 13:20:37.709479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 455/912] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:37 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:38.733878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:38.734740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:38.742553 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.743257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:38.744284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:38.744611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:38.935651 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:38.948799 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:38.950500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:38.951721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-368c960e-00da-477b-b2f7-573b45fc5ac1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.222045 Jun 07 13:20:38.952295 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 456/913] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:38 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:39.980663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:39.981449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:39.992085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.993001 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:39.994208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:39.994912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:40.211444 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.226872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.229156 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:40.230617 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-674dcede-51c8-4fda-8d6c-e6cecaa401bc tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.258630 Jun 07 13:20:40.237203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 457/914] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:39 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:41.262689 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:41.263654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:41.272038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.272813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.273794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:41.274294 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:41.461840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.476412 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.479071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:41.480797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a21e7d49-8ab5-4a61-9a77-21624904f237 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.224786 Jun 07 13:20:41.493997 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 458/915] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:41 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:42.514776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:42.515955 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:42.527718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.528348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.529292 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:42.529786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:42.764706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.775800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.778585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:42.780691 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e7889bde-1aed-4552-9f0c-5cd3bb0c621b tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.273082 Jun 07 13:20:42.781903 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 459/916] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:42 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:43.808035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:43.809644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:43.818582 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.819618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:43.820067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:43.820816 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:43.843133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:44.036923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.052262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.059779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:44.059779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-930d3b5d-9007-46bf-b2be-438fc6e048de tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.253401 Jun 07 13:20:44.060678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 460/917] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:43 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:45.087295 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:45.089467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:45.111482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.112239 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:45.113566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:45.114694 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:45.316684 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.339416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.342375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:45.344954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b22e7ec7-452a-4472-b838-53dc8c9309a2 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.264553 Jun 07 13:20:45.359639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 461/918] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:45 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:46.371420 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:46.372169 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:46.379069 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:46.379498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:46.380281 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:46.380738 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:46.507187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:46.529499 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.538106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.539630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:46.540900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1bd245dc-9f4a-4ff6-8c13-88f7803dd5f3 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.174002 Jun 07 13:20:46.541515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 462/919] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:46 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:46.597975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:20:47.562301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:47.562301 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:47.568227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.568674 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.569491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:47.569924 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:47.716204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.724769 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.726304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:47.727937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6d4712b9-6f21-436b-a707-dfbdad18a936 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.171557 Jun 07 13:20:47.728095 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 463/920] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:47 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:48.747697 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:48.748452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:48.755695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.756125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.756907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:48.757374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:48.907231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.915966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.917479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:48.918990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7a558c71-0dfb-4e5d-bcd5-d7cfa63d76d4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.177093 Jun 07 13:20:48.919747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 464/921] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:48 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:49.942242 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:49.943259 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:49.954227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:49.954975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:49.956244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:49.956967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:50.098493 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:50.111288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:50.112838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:50.114175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5b188e16-bee1-4a17-a292-460675de5451 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.178530 Jun 07 13:20:50.114756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 465/922] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:49 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:51.141523 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:51.143017 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:51.151804 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:51.152409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:51.153598 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:51.154047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:51.297974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.310565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.312812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:51.314696 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e4d16aba-02e8-40d2-9fe0-b95b329191d1 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.182669 Jun 07 13:20:51.315454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 466/923] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:51 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:51.622358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17f823d7-6efa-491a-aacb-a794ee9990b2 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.138711 Jun 07 13:20:51.622982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 458/924] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:20:36 2022] POST /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 194 bytes in 15140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:52.336055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:52.336693 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:52.343597 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.344041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.344812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:52.345280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:52.481298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:52.489708 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:52.491348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:52.492987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-5c583b12-9fa4-47c1-8864-da4e7c127563 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.161050 Jun 07 13:20:52.493571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 467/925] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:52 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:52.637790 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-da5a8020-f074-4b9d-83dd-2440f696e75a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: .version_select at 0x7f20a4773790>, body: {"keypair": {"name": "tempest-keypair-1919865530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfTK7iKVznbmFHTiGXavbZ++y9PTNlrByNxnDuaorS0ikZMzhQbBaUhFdxMQjDjJCWJpuY4CAiSpsg4O+An/OvZXsuxebvD8D4Ag3HCdsO8O+99jKXxjCu/EW7KF9ouuA=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:52.652258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-da5a8020-f074-4b9d-83dd-2440f696e75a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:52.656237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-da5a8020-f074-4b9d-83dd-2440f696e75a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:52.682196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-da5a8020-f074-4b9d-83dd-2440f696e75a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049425 Jun 07 13:20:52.683057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 459/926] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:20:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:53.510866 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:53.511475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:53.518850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:53.519307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:53.520181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:53.520683 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:53.661398 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:53.669934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:53.671533 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:53.672793 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8f682c6e-1e39-472f-83c8-656acda10eb7 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.166245 Jun 07 13:20:53.673481 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 468/927] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:53 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:54.069125 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1900565376", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4c5b29e-534b-4458-943d-262c9e18bfb9"}], "security_groups": [{"name": "tempest-securitygroup--1180309723"}], "key_name": "tempest-keypair-1919865530", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:54.176958 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] validate_networks() for [('a4c5b29e-534b-4458-943d-262c9e18bfb9', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:20:54.483224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3bab8937-374a-480c-9bb9-e1090d3a94ce req-78611fc9-3448-47f7-89c6-2fc66d440042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "name": "network-vif-plugged", "status": "completed", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:54.498897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3bab8937-374a-480c-9bb9-e1090d3a94ce req-78611fc9-3448-47f7-89c6-2fc66d440042 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.499344 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3bab8937-374a-480c-9bb9-e1090d3a94ce req-78611fc9-3448-47f7-89c6-2fc66d440042 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.512547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3bab8937-374a-480c-9bb9-e1090d3a94ce req-78611fc9-3448-47f7-89c6-2fc66d440042 service nova] Creating event network-vif-plugged:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:20:54.518373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3bab8937-374a-480c-9bb9-e1090d3a94ce req-78611fc9-3448-47f7-89c6-2fc66d440042 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039453 Jun 07 13:20:54.519682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 469/928] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:54.583407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:20:54.583828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:20:54.584302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:20:54.584711 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:20:54.585148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:20:54.594290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.594741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.595544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.595981 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.614077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:20:54.619133 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:20:54.630885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:20:54.633251 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:20:54.681945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-07ba6d48-6b79-4199-86cf-5712090010d8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617635 Jun 07 13:20:54.682635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 460/929] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:20:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:20:54.691665 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:54.692450 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:54.692951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6042a81d-17d3-4595-bbc1-b66a7b21bb9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:54.693789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6042a81d-17d3-4595-bbc1-b66a7b21bb9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:54.699449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.700079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.700850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:54.701332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:54.768756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6042a81d-17d3-4595-bbc1-b66a7b21bb9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:54.778929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6042a81d-17d3-4595-bbc1-b66a7b21bb9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1242 microversion: 2.1 time: 0.089791 Jun 07 13:20:54.788553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 461/930] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:54 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:54.877832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:54.885749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:54.887351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:54.888540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4341eb2d-4afe-4b5d-8aa4-bce817317114 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.201704 Jun 07 13:20:54.889120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 470/931] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:54 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:20:55.796513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:55.797263 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:55.804090 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.804579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.805438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.805876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.867603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:55.875759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b5f9757d-494d-4076-9d46-d515ba9cf2d1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1294 microversion: 2.1 time: 0.083462 Jun 07 13:20:55.876335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 462/932] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:55 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:55.907015 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:55.907618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:55.914403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.914961 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:55.915746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:55.916184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:56.051310 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:56.059746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:56.061280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:56.062452 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0fb93e96-58e2-489d-9ffd-48765c7ac182 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1730 microversion: 2.20 time: 0.159358 Jun 07 13:20:56.063019 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 471/933] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:55 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:56.893506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:56.894116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:56.900882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:56.901368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:56.902154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:56.902595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:56.979141 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:56.993552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e968698e-404c-4f48-ac74-ff89fbfa5880 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1300 microversion: 2.1 time: 0.103981 Jun 07 13:20:56.994132 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 463/934] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:56 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:20:57.081132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:57.081728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:57.088404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:57.088860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:57.089648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:57.090159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:57.225215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:57.233619 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:57.235239 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:57.236513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a0297625-affd-4fe7-ab5e-ce5b0699d8a4 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1717 microversion: 2.20 time: 0.159409 Jun 07 13:20:57.237391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 472/935] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:20:57 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:20:58.010893 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:58.011623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:58.018464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.019164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.019914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.020525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.264677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:58.272419 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c35e0f0b-0ec7-4b1b-8164-5763276bd034 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.265277 Jun 07 13:20:58.285255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 464/936] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:58 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:20:58.431925 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-1990ba3e-aba2-4dcc-976b-42dc5d4942e3 req-ca57fbb2-8911-4d08-b840-8d9622cd3c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7fcb9a-d081-447d-bb1e-02f1f08b3f71", "tag": "25fbe4e1-c87b-44b0-8640-68e8e31b01fe"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:20:58.458430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1990ba3e-aba2-4dcc-976b-42dc5d4942e3 req-ca57fbb2-8911-4d08-b840-8d9622cd3c4a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:58.459218 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-1990ba3e-aba2-4dcc-976b-42dc5d4942e3 req-ca57fbb2-8911-4d08-b840-8d9622cd3c4a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:58.474183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-1990ba3e-aba2-4dcc-976b-42dc5d4942e3 req-ca57fbb2-8911-4d08-b840-8d9622cd3c4a service nova] Creating event network-changed:25fbe4e1-c87b-44b0-8640-68e8e31b01fe for instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 on hv-cinder-84496 Jun 07 13:20:58.479291 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-1990ba3e-aba2-4dcc-976b-42dc5d4942e3 req-ca57fbb2-8911-4d08-b840-8d9622cd3c4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053230 Jun 07 13:20:58.479883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 473/937] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:20:59.179194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:59.180191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:59.186983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.187462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.188236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.188669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.218748 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e10432a4-2062-4add-8b22-f3b396037ec1 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 Jun 07 13:20:59.219553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 465/938] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:20:59 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:59.229986 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:59.230662 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:59.237521 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.238201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.239150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.239742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.269647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47e681f9-9eb4-4172-b1d4-40b6611199fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7" status: 200 len: 194 microversion: 2.1 time: 0.043971 Jun 07 13:20:59.270268 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 474/939] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jun 7 13:20:59 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:20:59.292633 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:20:59.293291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:20:59.299669 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.300112 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.300880 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:20:59.301345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:20:59.489059 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:20:59.500042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7a771493-99f1-4293-a940-0d28de566f69 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.211105 Jun 07 13:20:59.500784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 466/940] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:20:59 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:00.523383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:00.524258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:00.533514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.533962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.534730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.535162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.609762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc17eb6b-6397-4aa3-90f5-bc702b86140d"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:00.610958 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:00.618160 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.618692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.619606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:00.620093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:00.678332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:00.686173 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9415959d-cdfc-44ba-94ff-d16095de9dc2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.169356 Jun 07 13:21:00.686835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 475/941] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:00 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:01.704608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:01.705426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:01.713384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:01.713885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:01.714769 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:01.715311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:01.855610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:01.863307 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0c876a9a-d9e0-455d-a735-ab6820efa69a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.163206 Jun 07 13:21:01.863806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 476/942] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:01 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:01.905442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2e2dacdb-ce86-4590-96b1-68fa062e174e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "POST /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.299957 Jun 07 13:21:01.906216 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 467/943] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:21:00 2022] POST /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 194 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:02.885376 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:02.886339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:02.894666 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.895113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:02.895879 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:02.896312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:03.039180 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:03.047111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f7bfba61-fde1-4fdf-953f-1a17d6ae5981 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.168595 Jun 07 13:21:03.047756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 477/944] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:02 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:04.065647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:04.066344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:04.073044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.073521 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.074296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.074728 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.212114 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:04.220094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-17bc7a10-6c76-45b6-89f1-52389d2f9f2a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.159224 Jun 07 13:21:04.220660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 468/945] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:04 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:04.531936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-4cc6e4e1-efc9-4459-a8c3-b2fc82adf9b7 req-5d0fad70-3b12-4fcc-9b19-8e2324ef07f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7fcb9a-d081-447d-bb1e-02f1f08b3f71", "name": "network-vif-plugged", "status": "completed", "tag": "25fbe4e1-c87b-44b0-8640-68e8e31b01fe"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:04.541337 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-4cc6e4e1-efc9-4459-a8c3-b2fc82adf9b7 req-5d0fad70-3b12-4fcc-9b19-8e2324ef07f3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:04.541855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-4cc6e4e1-efc9-4459-a8c3-b2fc82adf9b7 req-5d0fad70-3b12-4fcc-9b19-8e2324ef07f3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:04.554647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-4cc6e4e1-efc9-4459-a8c3-b2fc82adf9b7 req-5d0fad70-3b12-4fcc-9b19-8e2324ef07f3 service nova] Creating event network-vif-plugged:25fbe4e1-c87b-44b0-8640-68e8e31b01fe for instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 on hv-cinder-84496 Jun 07 13:21:04.559724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-4cc6e4e1-efc9-4459-a8c3-b2fc82adf9b7 req-5d0fad70-3b12-4fcc-9b19-8e2324ef07f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Jun 07 13:21:04.560615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 478/946] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:05.237877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:05.238441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:05.240870 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:05.241932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=12 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:05.248031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.248462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:05.249271 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:05.249709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:05.393166 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:05.406189 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8c25f967-f57d-4038-9390-4c4cd4a19598 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.172066 Jun 07 13:21:05.407097 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 469/947] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:05 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:06.433004 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:06.433761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:06.437185 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=50 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:06.443292 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.443738 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.444508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:06.444941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:06.447552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:06.592090 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:06.599891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a70b53a3-d213-491d-a6f3-08f4ddecbba4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1368 microversion: 2.1 time: 0.173856 Jun 07 13:21:06.600464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 479/948] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:06 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:07.617606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.618249 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.625730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.626164 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.626937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.627380 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.764963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:07.776524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-174322b2-e2a1-449c-bc7e-639292e304bc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1558 microversion: 2.1 time: 0.162959 Jun 07 13:21:07.777140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 470/949] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:07.794108 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:07.794632 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:07.801630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.802085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.802850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:07.803278 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:07.891403 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d6acb4c-8e36-4d0b-b4c2-1bb384dfc8d6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101120 Jun 07 13:21:07.892002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 480/950] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:21:07 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:08.873049 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-f23e2e57-98ed-40ae-b49b-2c4ae6dc134a req-c4995849-af86-47f8-b12f-0d13206d8c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e7fcb9a-d081-447d-bb1e-02f1f08b3f71", "tag": "25fbe4e1-c87b-44b0-8640-68e8e31b01fe"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:08.882165 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f23e2e57-98ed-40ae-b49b-2c4ae6dc134a req-c4995849-af86-47f8-b12f-0d13206d8c6c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:08.882875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-f23e2e57-98ed-40ae-b49b-2c4ae6dc134a req-c4995849-af86-47f8-b12f-0d13206d8c6c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:08.896863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-f23e2e57-98ed-40ae-b49b-2c4ae6dc134a req-c4995849-af86-47f8-b12f-0d13206d8c6c service nova] Creating event network-changed:25fbe4e1-c87b-44b0-8640-68e8e31b01fe for instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 on hv-cinder-84496 Jun 07 13:21:08.902426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-f23e2e57-98ed-40ae-b49b-2c4ae6dc134a req-c4995849-af86-47f8-b12f-0d13206d8c6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033220 Jun 07 13:21:08.903021 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 471/951] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:09.432672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:09.434230 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:09.440812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.441438 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.442314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.442835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.473464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e0522bbb-6e3a-4a2b-a5fd-dca85e7a4655 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044636 Jun 07 13:21:09.474216 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 481/952] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:09 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:09.623736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:09.624686 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:09.631235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.631681 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.632438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.632868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.663482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5942d4da-e609-4796-99ca-6eeb1bf7d596 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7" status: 200 len: 194 microversion: 2.1 time: 0.044091 Jun 07 13:21:09.664108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 472/953] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jun 7 13:21:09 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:09.674249 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:09.674747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:09.681321 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.681775 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.682531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:09.682995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:09.767987 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lazy-loading 'services' on Instance uuid 42d0a196-b7cb-4a84-8f34-ea0eb83529ac {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:09.844692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ed3fc7fa-4d21-4453-8259-96b3406a3041 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7" status: 202 len: 0 microversion: 2.1 time: 0.174615 Jun 07 13:21:09.845456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 482/954] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:21:09 2022] DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/29290931-de11-4cb9-844d-c345c621c4d7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:12.022740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:12.023312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:12.033239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.033701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.035622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.036076 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.071682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ec022edc-5b60-4db4-8757-188fb1bfa487 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/cc17eb6b-6397-4aa3-90f5-bc702b86140d" status: 200 len: 194 microversion: 2.1 time: 0.053674 Jun 07 13:21:12.072602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 473/955] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jun 7 13:21:12 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/cc17eb6b-6397-4aa3-90f5-bc702b86140d => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:21:12.087164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:12.087752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:12.094551 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.095228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.096038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:12.096611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:12.196936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lazy-loading 'services' on Instance uuid 42d0a196-b7cb-4a84-8f34-ea0eb83529ac {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:21:12.287703 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0faab70c-c0fc-4d05-a3ab-5f1ae810b879 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/cc17eb6b-6397-4aa3-90f5-bc702b86140d" status: 202 len: 0 microversion: 2.1 time: 0.206167 Jun 07 13:21:12.288356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 483/956] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:21:12 2022] DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments/cc17eb6b-6397-4aa3-90f5-bc702b86140d => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:13.474121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.475055 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.481846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.482308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.483046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.483473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.515976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-64fd8eff-7a73-45b7-8099-fab267f5a255 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045676 Jun 07 13:21:13.516481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 474/957] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:21:13.631491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.632473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.639199 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.639658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.640407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.640835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.670835 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c6f88d01-2d53-49cd-823a-18435302b89f tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044343 Jun 07 13:21:13.671396 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 484/958] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:21:13.732416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.733057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.739789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.740250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.741075 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.741883 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.767940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:13.782341 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:13.854878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41d3d76c-2f1e-4ac4-b9a9-787afc6d17f6 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 204 len: 0 microversion: 2.1 time: 0.127429 Jun 07 13:21:13.855548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 475/959] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:13 2022] DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:21:13.867137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:13.868103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:13.877151 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.877766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:13.878991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:13.879612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:14.048753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:14.056578 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3a409d39-f1a2-4724-8968-f6b09b5a20ca tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1672 microversion: 2.1 time: 0.196229 Jun 07 13:21:14.057183 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 485/960] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:13 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:15.075980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:15.076668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:15.083890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:15.084339 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:15.085150 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:15.085584 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:15.235553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:15.243796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c34addb4-a2d4-431f-8ff8-de21d9321612 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1672 microversion: 2.1 time: 0.172595 Jun 07 13:21:15.244399 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 476/961] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:15 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:16.263378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:16.264101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:16.272562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.273131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.274010 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.274469 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.420169 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e6349a50ec4554b27b94b3f0f2dcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d29a15ba1f484fbd98c93d98b42c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:16.432446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-05f43813-d134-4044-99bb-8ff5165c7a3e tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 200 len: 1672 microversion: 2.1 time: 0.173154 Jun 07 13:21:16.433454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 486/962] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:16 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:16.792732 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d9accebc-743e-4783-8569-2b158d7a0051 req-38eb2c4b-62c6-4414-9185-7899b9c98430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d0a196-b7cb-4a84-8f34-ea0eb83529ac", "name": "network-vif-deleted", "tag": "d73f4a62-e421-4259-8eb1-a68ee1369493"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:16.798076 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:16.807347 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d9accebc-743e-4783-8569-2b158d7a0051 req-38eb2c4b-62c6-4414-9185-7899b9c98430 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:16.807960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d9accebc-743e-4783-8569-2b158d7a0051 req-38eb2c4b-62c6-4414-9185-7899b9c98430 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:16.826460 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d9accebc-743e-4783-8569-2b158d7a0051 req-38eb2c4b-62c6-4414-9185-7899b9c98430 service nova] Creating event network-vif-deleted:d73f4a62-e421-4259-8eb1-a68ee1369493 for instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac on hv-cinder-84496 Jun 07 13:21:16.834366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d9accebc-743e-4783-8569-2b158d7a0051 req-38eb2c4b-62c6-4414-9185-7899b9c98430 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045804 Jun 07 13:21:16.835308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 477/963] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:17.460755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:17.462948 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:17.477846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.478803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.480922 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:17.482002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:17.509476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac HTTP/1.1 Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:21:17.512967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:17.515833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '42d0a196-b7cb-4a84-8f34-ea0eb83529ac'} Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:17.517813 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:17.521959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:17.531630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:17.531630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-04f63bec-8a41-4fec-8d6c-ac3d04432470 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 404 len: 111 microversion: 2.1 time: 0.073030 Jun 07 13:21:17.531630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 487/964] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:17 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:21:17.536946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4e29cd85-a784-49f3-a496-f2724b9d00fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '.version_select at 0x7f20a4689700>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:17.556226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4e29cd85-a784-49f3-a496-f2724b9d00fe tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993722588" status: 202 len: 0 microversion: 2.1 time: 0.023883 Jun 07 13:21:17.557276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 478/965] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jun 7 13:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993722588 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:21:20.781539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:20.782049 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:20.789808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.790262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.791037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.791489 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.805913 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac HTTP/1.1 Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:21:20.807475 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.808968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '42d0a196-b7cb-4a84-8f34-ea0eb83529ac'} Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:20.809740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.811082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.812483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:20.812483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c3bc6286-1b9d-4f9d-9a54-131d32bea7bf tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 404 len: 111 microversion: 2.1 time: 0.033532 Jun 07 13:21:20.812483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:20 2022] DELETE /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:20.817897 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:20.818627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: 42d0a196-b7cb-4a84-8f34-ea0eb83529ac] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:20.825829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.826276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.827042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:20.827475 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:20.841190 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac HTTP/1.1 Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:21:20.842841 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.844360 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '42d0a196-b7cb-4a84-8f34-ea0eb83529ac'} Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:20.845236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. Jun 07 13:21:20.846766 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:20.848083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance 42d0a196-b7cb-4a84-8f34-ea0eb83529ac could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:20.848083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b3332c5f-6c82-41af-8414-1bbfd8a9c8dc tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac" status: 404 len: 111 microversion: 2.1 time: 0.030635 Jun 07 13:21:20.848083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 479/967] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:20 2022] GET /compute/v2.1/servers/42d0a196-b7cb-4a84-8f34-ea0eb83529ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:21.989208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:21.989743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:21.996868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.997354 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:21.998108 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:21.998538 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.013865 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f HTTP/1.1 Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:21:22.015482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.016840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'd5202ff0-c8c1-4c4f-a89c-f536f724298f'} Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:22.017600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.019339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.020876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:22.020876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e73c5155-5312-4fd9-a2a0-de92999b9332 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 404 len: 111 microversion: 2.1 time: 0.031762 Jun 07 13:21:22.020876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 489/968] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:21:21 2022] DELETE /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:22.025691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:22.026306 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] [instance: d5202ff0-c8c1-4c4f-a89c-f536f724298f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:22.032919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:22.033408 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.034282 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:22.034724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:22.048564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] HTTP exception thrown: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Request method failure captured: Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f HTTP/1.1 Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06hipFKZPE5HPEYqxY-0tMJu_Jqnjpazi3CKeL3rWbxJXDbJI362kqYrEdEmDFTMJWrlJxG24-_McqN_PZVj2X8Z5S5wLzBX57kFvh1gXGgWeSQY6D_cLw7MiAzfsQQ2kVurSObYBTEApcht-hZuVnSVNsh5s45KhIiIeXlQp0099s Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:21:22.050162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_63d29a15ba1f484fbd98c93d98b42c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 63d29a15ba1f484fbd98c93d98b42c7e Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297148601 Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: e1e6349a50ec4554b27b94b3f0f2dcbd Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeTestJSON-297148601-project Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.051718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd5202ff0-c8c1-4c4f-a89c-f536f724298f'} Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:22.052535 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. Jun 07 13:21:22.053896 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:22.055170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] Returning 404 to user: Instance d5202ff0-c8c1-4c4f-a89c-f536f724298f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:22.055170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-89009a3f-52fa-452f-81f0-2b22a0090762 tempest-AttachVolumeTestJSON-297148601 tempest-AttachVolumeTestJSON-297148601-project] 10.222.0.20 "GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f" status: 404 len: 111 microversion: 2.1 time: 0.029748 Jun 07 13:21:22.055170 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 480/969] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:22 2022] GET /compute/v2.1/servers/d5202ff0-c8c1-4c4f-a89c-f536f724298f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:21:53.231482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.232503 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.237937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=21 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:53.239126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:53.241910 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.242494 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.243609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.244106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.276799 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9b48ccb8-2d7e-4c9b-91a3-d0fa99d07298 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049574 Jun 07 13:21:53.277383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 490/970] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jun 7 13:21:53 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:53.335697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.336258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.338650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:53.339324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:21:53.345193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.345658 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.346426 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.346855 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.375886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:21:53.464262 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3231f5a0-1813-40f0-bd99-0bebf4ba2122 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 204 len: 0 microversion: 2.20 time: 0.132758 Jun 07 13:21:53.472948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 481/971] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jun 7 13:21:53 2022] DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:21:53.478165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:53.478968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:53.487239 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.487757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.489260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:53.489800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:53.766378 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.774947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.776593 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:53.777812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d3f12f45-744a-4b60-abd7-7be3a174b952 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.303722 Jun 07 13:21:53.778336 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 491/972] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:53 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 13:21:54.799219 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:54.800565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:54.811163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.811946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:54.813050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:54.813691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.036246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.045197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.046702 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.047876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6424067f-4c53-4ea4-8db6-69243c886768 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1723 microversion: 2.20 time: 0.254864 Jun 07 13:21:55.048451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 482/973] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:54 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:55.153303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1390171329", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "networks": [{"uuid": "f9d8fcd0-2d1c-4967-88d7-db3bf160bc9c"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:55.207564 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] validate_networks() for [('f9d8fcd0-2d1c-4967-88d7-db3bf160bc9c', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:21:55.566165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:21:55.566650 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:21:55.567186 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:21:55.567651 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:21:55.568146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:21:55.577637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.578334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.579153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:55.579592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:55.597962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Getting quotas for project dbeb18fed89a458e9ba2a998a73fe899. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:21:55.602739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Getting quotas for user 6ccfbda39c494fcfadded542666d3df3 and project dbeb18fed89a458e9ba2a998a73fe899. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:21:55.614328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:21:55.617824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:21:55.664649 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4996d6d2-c88f-4e68-8f09-ff41ae0ebe87 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515247 Jun 07 13:21:55.666113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 492/974] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:21:55.675950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5161ee34-794d-4b42-91f4-113706a1105f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:55.676649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5161ee34-794d-4b42-91f4-113706a1105f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:55.749985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5161ee34-794d-4b42-91f4-113706a1105f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:55.757776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5161ee34-794d-4b42-91f4-113706a1105f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1219 microversion: 2.1 time: 0.085694 Jun 07 13:21:55.758365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 483/975] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:55 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:56.036472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-3c6be801-0e56-492a-848c-9f4930a2f85a req-ba132cf6-1d2a-4449-828d-35c66e75a598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d341eab7-1862-4ff7-ae50-991185475a8f", "name": "network-vif-deleted", "tag": "f025d2e1-d003-4216-987e-411a59aefbb8"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:56.056287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3c6be801-0e56-492a-848c-9f4930a2f85a req-ba132cf6-1d2a-4449-828d-35c66e75a598 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.057172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-3c6be801-0e56-492a-848c-9f4930a2f85a req-ba132cf6-1d2a-4449-828d-35c66e75a598 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.073225 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:56.074303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-3c6be801-0e56-492a-848c-9f4930a2f85a req-ba132cf6-1d2a-4449-828d-35c66e75a598 service nova] Creating event network-vif-deleted:f025d2e1-d003-4216-987e-411a59aefbb8 for instance d341eab7-1862-4ff7-ae50-991185475a8f on hv-cinder-84496 Jun 07 13:21:56.074547 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:56.085785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-3c6be801-0e56-492a-848c-9f4930a2f85a req-ba132cf6-1d2a-4449-828d-35c66e75a598 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057174 Jun 07 13:21:56.087519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 493/976] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:56.088343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.095455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.096571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.097123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.190012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:56.200700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:56.203052 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b341180925b454094d9bf5e6f5b3eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6b89da4e96480ba68652cff770b388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:56.204683 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-394316e3-1ab1-4f9a-b41b-ed2a4435a5ef tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 200 len: 1367 microversion: 2.20 time: 0.141713 Jun 07 13:21:56.205540 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 484/977] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:56 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 1367 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 13:21:56.774686 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:56.775328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:56.782508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.782995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.783752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:56.784179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:56.851702 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:56.859716 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0debe898-906a-4bb5-bd90-fd7e65c36942 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1271 microversion: 2.1 time: 0.089324 Jun 07 13:21:56.860663 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 494/978] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:56 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:57.223181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.223842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:57.230886 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.231342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.232270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.232697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.253383 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f HTTP/1.1 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:21:57.255063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:21:57.256851 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd341eab7-1862-4ff7-ae50-991185475a8f'} Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:21:57.257777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:21:57.259303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:21:57.260705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:21:57.260705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f039f177-49fd-4109-945b-5addd10605cb tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 404 len: 111 microversion: 2.20 time: 0.037588 Jun 07 13:21:57.260705 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 485/979] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:21:57 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:21:57.265867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7694cf5e-a0fb-4c4f-9d5f-075e11e45a1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '.version_select at 0x7f20a4a2c310>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.269375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7694cf5e-a0fb-4c4f-9d5f-075e11e45a1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [26294060-91d7-452a-94c7-1d8b344e6deb] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 13:21:57.878038 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:57.878748 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:57.885997 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.886993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:57.887932 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:57.888478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.106157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:58.114355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-61a112e0-f2b9-4bcb-8428-e404f9658fca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.240312 Jun 07 13:21:58.114924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 486/980] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:57 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:21:58.278921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [None req-7694cf5e-a0fb-4c4f-9d5f-075e11e45a1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [26294060-91d7-452a-94c7-1d8b344e6deb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59658. Jun 07 13:21:58.299975 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7694cf5e-a0fb-4c4f-9d5f-075e11e45a1f tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807239812" status: 204 len: 0 microversion: 2.20 time: 1.037895 Jun 07 13:21:58.300573 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 495/981] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Jun 7 13:21:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807239812 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 13:21:58.439518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-29c383c1-f397-4a07-9859-dfad17dc8acf req-ee46ada3-4fbf-4385-b399-1f726ed035f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34", "tag": "76b17f72-75a0-4fd0-a6ad-39037ad41025"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:21:58.448950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-29c383c1-f397-4a07-9859-dfad17dc8acf req-ee46ada3-4fbf-4385-b399-1f726ed035f3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:58.449939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-29c383c1-f397-4a07-9859-dfad17dc8acf req-ee46ada3-4fbf-4385-b399-1f726ed035f3 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:58.462476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-29c383c1-f397-4a07-9859-dfad17dc8acf req-ee46ada3-4fbf-4385-b399-1f726ed035f3 service nova] Creating event network-changed:76b17f72-75a0-4fd0-a6ad-39037ad41025 for instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 on hv-cinder-84496 Jun 07 13:21:58.467890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-29c383c1-f397-4a07-9859-dfad17dc8acf req-ee46ada3-4fbf-4385-b399-1f726ed035f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 Jun 07 13:21:58.468983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 487/982] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:21:59.136148 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:21:59.136968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:21:59.149547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.149994 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.150758 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:21:59.151201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:21:59.288455 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:21:59.296377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-686034fc-a516-4528-9423-731017c1a0a4 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.167163 Jun 07 13:21:59.296964 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 496/983] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:21:59 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:00.319467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:00.320054 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:00.326827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.327300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.328063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:00.328493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:00.469493 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:00.477346 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-466fd12f-442f-40ce-b70c-7734b6385885 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.166051 Jun 07 13:22:00.477909 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 488/984] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:00 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:01.496647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:01.498700 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:01.506693 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:01.507254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:01.508234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:01.508731 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:01.652726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:01.664221 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-94ac0337-648e-4fc3-a303-4fdcc51fba53 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.171561 Jun 07 13:22:01.665508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 497/985] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:01 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:02.354518 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:02.355121 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:02.362148 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.362591 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.363354 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.363784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.378095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f HTTP/1.1 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:22:02.379937 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.381616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd341eab7-1862-4ff7-ae50-991185475a8f'} Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:02.382564 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.384000 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.385847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:02.385847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ea84f9f2-84ce-4637-8648-17834d3e3148 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 404 len: 111 microversion: 2.20 time: 0.031058 Jun 07 13:22:02.385847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 489/986] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jun 7 13:22:02 2022] DELETE /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:02.390655 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:02.391264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: d341eab7-1862-4ff7-ae50-991185475a8f] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:02.397711 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.398086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.398855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.399282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.413637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f HTTP/1.1 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:02.415437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.417204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'd341eab7-1862-4ff7-ae50-991185475a8f'} Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:02.418189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. Jun 07 13:22:02.419783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:02.422220 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance d341eab7-1862-4ff7-ae50-991185475a8f could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:02.422220 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-564e17b2-4216-4a30-8846-426782ea2c77 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f" status: 404 len: 111 microversion: 2.20 time: 0.030329 Jun 07 13:22:02.427263 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 498/987] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:02 2022] GET /compute/v2.1/servers/d341eab7-1862-4ff7-ae50-991185475a8f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:02.684866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:02.685576 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:02.693696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.694264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.695215 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:02.695791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:02.837449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:02.845193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-061dcc70-6b93-4bf9-a807-af0ab6ba707a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.165838 Jun 07 13:22:02.845778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 490/988] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:02 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:03.564030 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.564572 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:03.571048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.571633 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.572560 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.572994 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.586836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 HTTP/1.1 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:03.588544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.590255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '4f0a617c-95aa-46f2-8159-056830649054'} Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:03.591117 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.592558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.594280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:03.594280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-555d7533-ff75-439a-bfc6-c02c3f451370 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 404 len: 111 microversion: 2.20 time: 0.030142 Jun 07 13:22:03.594280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 499/989] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jun 7 13:22:03 2022] DELETE /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:03.598561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.599204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] [instance: 4f0a617c-95aa-46f2-8159-056830649054] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:03.606199 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.606656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.607473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.607898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.623505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] HTTP exception thrown: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Request method failure captured: Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 HTTP/1.1 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin06gE9rhjbfJ-RPQ8s3nkQLT7OykYZnbeKVvFvPQx5-lykXV3Duq-Ibsu52OnsgBAi_8eHtpyusovr3FWUxFmWr1WH58_PrKhLv4WT2V3OvIgnx5NTqgUI3IaWFVVYoc7yxV15sAXuT9Nln6YcmHNtuj8bjbg7cm8MtaslLzoVKK410 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:22:03.625316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c6b89da4e96480ba68652cff770b388"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c6b89da4e96480ba68652cff770b388"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 6c6b89da4e96480ba68652cff770b388 Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-820175996 Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 8b341180925b454094d9bf5e6f5b3eaf Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-820175996-project Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.626704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '4f0a617c-95aa-46f2-8159-056830649054'} Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:03.627562 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. Jun 07 13:22:03.628724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:03.629868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] Returning 404 to user: Instance 4f0a617c-95aa-46f2-8159-056830649054 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:03.629868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6f1b3a0a-ef33-468d-8c19-5a37040f0b12 tempest-AttachVolumeShelveTestJSON-820175996 tempest-AttachVolumeShelveTestJSON-820175996-project] 10.222.0.20 "GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054" status: 404 len: 111 microversion: 2.20 time: 0.032177 Jun 07 13:22:03.629868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 491/990] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jun 7 13:22:03 2022] GET /compute/v2.1/servers/4f0a617c-95aa-46f2-8159-056830649054 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:03.862342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:03.863182 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:03.870695 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.871165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:03.871943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:03.872375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:04.081386 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:04.089688 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3f94e678-1dd4-43b1-967b-0858f97c9d7a tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.231207 Jun 07 13:22:04.090277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 500/991] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:03 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:05.106391 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:05.107155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:05.114273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.114715 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.115490 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:05.116321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:05.260750 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:05.268690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-81940990-81df-4eb2-998d-ee1f6499823c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.166331 Jun 07 13:22:05.269370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 492/992] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:05 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:06.294251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:06.295537 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:06.302645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:06.303672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:06.306685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.308003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.310189 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:06.310947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:06.517832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:06.528095 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3fdad8c0-260e-4ec6-964a-dc5b1fc3911e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.240319 Jun 07 13:22:06.528977 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 501/993] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:06 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:07.547305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:07.547923 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:07.550284 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:07.560237 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.561528 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.562524 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:07.563366 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:07.711672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:07.719358 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-91184418-378e-4b0f-b5e7-105ace5cbfa0 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.175972 Jun 07 13:22:07.719930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 493/994] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:07 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:08.736296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:08.737532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:08.744126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.744609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.745431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.745842 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.845293 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-5f744cdd-eb22-48c3-9428-299e16727c4b req-1392247e-d329-4a40-b0cc-34ce5614a93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34", "name": "network-vif-plugged", "status": "completed", "tag": "76b17f72-75a0-4fd0-a6ad-39037ad41025"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:08.862810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5f744cdd-eb22-48c3-9428-299e16727c4b req-1392247e-d329-4a40-b0cc-34ce5614a93a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:08.863318 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-5f744cdd-eb22-48c3-9428-299e16727c4b req-1392247e-d329-4a40-b0cc-34ce5614a93a service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:08.878441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-5f744cdd-eb22-48c3-9428-299e16727c4b req-1392247e-d329-4a40-b0cc-34ce5614a93a service nova] Creating event network-vif-plugged:76b17f72-75a0-4fd0-a6ad-39037ad41025 for instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 on hv-cinder-84496 Jun 07 13:22:08.884187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-5f744cdd-eb22-48c3-9428-299e16727c4b req-1392247e-d329-4a40-b0cc-34ce5614a93a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042446 Jun 07 13:22:08.885605 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 494/995] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:08.902179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:08.910608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b016823e-f1ad-4219-88a4-d867d7816e16 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.178036 Jun 07 13:22:08.911991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 502/996] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:08 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:08.954907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662325356", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-624960488", "security_groups": [{"name": "tempest-secgroup-smoke-813133215"}], "block_device_mapping_v2": [{"uuid": "bb101a45-0441-4b19-9d1b-a0ab1f7d9c8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d3913f7-d82f-4020-8fba-805cb52d0d5c"}]}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:09.079489 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] validate_networks() for [('8d3913f7-d82f-4020-8fba-805cb52d0d5c', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:22:09.528672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:22:09.529117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:22:09.529588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:22:09.529992 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:22:09.530444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:22:09.541044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.541577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.543916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.544356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.566314 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:22:09.570356 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Getting quotas for user 43f9e7923ebb4939ac2bd590270b48d7 and project 03491cee113744268fc89b63330c21c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:22:09.629718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:22:09.631976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb101a45-0441-4b19-9d1b-a0ab1f7d9c8b',volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:22:09.723856 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2746c071-4da4-43e4-b002-5a94f75373e2 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a48f2280>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.773656 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2746c071-4da4-43e4-b002-5a94f75373e2 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3cb7e3e4-fdb1-495e-b85c-9f288c075642" status: 200 len: 350 microversion: 2.1 time: 0.053881 Jun 07 13:22:09.775003 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 503/997] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/os-volumes/3cb7e3e4-fdb1-495e-b85c-9f288c075642 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:09.780927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-691bc9b1-75ba-41b8-990d-453f497ea4c4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825292 Jun 07 13:22:09.780927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 495/998] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:22:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:22:09.788919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6aa6fb6a-8676-4dd3-af04-f6bb7c5fac8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.789963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6aa6fb6a-8676-4dd3-af04-f6bb7c5fac8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.853108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6aa6fb6a-8676-4dd3-af04-f6bb7c5fac8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:09.861565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6aa6fb6a-8676-4dd3-af04-f6bb7c5fac8e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1093 microversion: 2.1 time: 0.076656 Jun 07 13:22:09.862157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 496/999] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:09.930304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:09.930963 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:09.937685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.938128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:09.938941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:09.939375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.110979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.119698 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-34c254a5-4580-45f1-ba7a-a8f11da40b14 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1319 microversion: 2.1 time: 0.193225 Jun 07 13:22:10.120645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 504/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:09 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:10.878559 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:10.879098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:10.887145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.887600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.888375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:10.888813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:10.956960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:10.964764 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-89153bdd-0a8a-4117-b808-dc28ea21faf4 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1191 microversion: 2.1 time: 0.090265 Jun 07 13:22:10.965771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 497/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:10 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:11.138377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:11.138984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:11.145985 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.146429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.147190 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.147620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.157786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-be463422-fbec-47bd-a39e-b0130a7f238b tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4689430>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:11.207509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-be463422-fbec-47bd-a39e-b0130a7f238b tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eb473e14-42f3-4d24-aad0-919e37088f38" status: 200 len: 350 microversion: 2.1 time: 0.053495 Jun 07 13:22:11.208112 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 498/1002] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:22:11 2022] GET /compute/v2.1/os-volumes/eb473e14-42f3-4d24-aad0-919e37088f38 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:11.283192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:11.292367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d91ce5f-8b16-4361-828e-22331498996f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1507 microversion: 2.1 time: 0.158123 Jun 07 13:22:11.293261 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 505/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:11 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:11.986069 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:11.988622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:11.994889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.995478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:11.996332 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:11.996859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:12.096512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:12.104849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d1e4eb07-bfa3-4220-bd09-acf549468995 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1209 microversion: 2.1 time: 0.126407 Jun 07 13:22:12.105704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 499/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:11 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:12.579753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-47caee69-50e3-4925-ae30-f32339dd57ed tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4a70820>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.640171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-47caee69-50e3-4925-ae30-f32339dd57ed tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f3b18609-7713-4542-8c7c-fe6443f652b8" status: 200 len: 351 microversion: 2.1 time: 0.064842 Jun 07 13:22:12.647707 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 506/1005] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/os-volumes/f3b18609-7713-4542-8c7c-fe6443f652b8 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:12.653386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9193b662-6db0-40da-8a66-462cea04204e tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a482aca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.750226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9193b662-6db0-40da-8a66-462cea04204e tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.100896 Jun 07 13:22:12.753107 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 500/1006] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:12.764543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b4d6dcb4-a290-49e5-abe5-2ed183c067c9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4905550>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.851343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b4d6dcb4-a290-49e5-abe5-2ed183c067c9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090584 Jun 07 13:22:12.851926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 507/1007] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:12.864420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-307c52d0-2df7-4e79-ab6e-894e8962591a tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4773ca0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:12.961444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-307c52d0-2df7-4e79-ab6e-894e8962591a tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099787 Jun 07 13:22:12.961444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 501/1008] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:12.972167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c5609a91-7fea-41d4-9d7d-36d46bbd0353 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4833670>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.054839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c5609a91-7fea-41d4-9d7d-36d46bbd0353 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086425 Jun 07 13:22:13.055446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 508/1009] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Jun 7 13:22:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:13.067829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f567acc2-7259-47e9-9664-ed9cfee255c9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a47eaee0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.124460 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.125110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:13.132101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.132547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.133376 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.134026 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.170742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f567acc2-7259-47e9-9664-ed9cfee255c9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107333 Jun 07 13:22:13.171573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 502/1010] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:13.188350 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b68ac8f3-5ded-460e-b21d-3b262d0445f2 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a4773af0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.296275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b68ac8f3-5ded-460e-b21d-3b262d0445f2 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.114420 Jun 07 13:22:13.296834 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 503/1011] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:13.309523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-374d17c6-fd6f-40c0-808f-8de91bd516f9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a6423f70>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.334598 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:13.343237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-94e7d475-d1c6-44e8-9ad9-d6e0d6bc5aa7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.222678 Jun 07 13:22:13.343834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 509/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:13.426036 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-374d17c6-fd6f-40c0-808f-8de91bd516f9 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.120575 Jun 07 13:22:13.427291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 504/1013] 10.222.0.20 () {58 vars in 1187 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:13.440785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6e36bad0-ad25-4c42-988a-59d76ed854b8 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] Calling method '.version_select at 0x7f20a47aeaf0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:13.535172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-96281e24-fc05-4688-85bf-c3e70b9c9c8a req-de1034b7-2ad6-4cf5-8460-e7a909a74062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:13.544849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-96281e24-fc05-4688-85bf-c3e70b9c9c8a req-de1034b7-2ad6-4cf5-8460-e7a909a74062 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:13.545255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-96281e24-fc05-4688-85bf-c3e70b9c9c8a req-de1034b7-2ad6-4cf5-8460-e7a909a74062 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:13.548547 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6e36bad0-ad25-4c42-988a-59d76ed854b8 tempest-VolumesTestJSON-1967491536 tempest-VolumesTestJSON-1967491536-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.113537 Jun 07 13:22:13.552951 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 505/1014] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jun 7 13:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:13.558604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-96281e24-fc05-4688-85bf-c3e70b9c9c8a req-de1034b7-2ad6-4cf5-8460-e7a909a74062 service nova] Creating event network-changed:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:22:13.569779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-96281e24-fc05-4688-85bf-c3e70b9c9c8a req-de1034b7-2ad6-4cf5-8460-e7a909a74062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224475 Jun 07 13:22:13.572536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 510/1015] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:14.365154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:14.366574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:14.374301 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.374748 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.375545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:14.375972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:14.513640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:14.526298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b2b17683-de49-4a49-81f6-73acec938213 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.168187 Jun 07 13:22:14.526929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 506/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:14 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:15.544246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:15.545038 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:15.552159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.552600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.553402 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:15.553831 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:15.707213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:15.714839 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1bebea51-3b45-47a3-bbd7-933ebe112448 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.175010 Jun 07 13:22:15.715407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 511/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:15 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:16.737863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:16.739251 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:16.751265 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.751905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.752776 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:16.753253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:16.904539 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:16.916257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6c689ffe-08d6-4a08-b91d-876c5025078d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.186972 Jun 07 13:22:16.917085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 507/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:16 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:17.933940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:17.934575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:17.941639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.942088 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:17.942859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:17.943296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:18.094972 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:18.102600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b919c8de-edd2-43c7-a853-838b0b5570c5 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.172685 Jun 07 13:22:18.103165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 512/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:17 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:18.481765 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83699342-596a-4b65-bf19-2a08a77eeb58 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Action: 'create', calling method: .version_select at 0x7f20a4773e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1806060492", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83699342-596a-4b65-bf19-2a08a77eeb58 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 122 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:22:18.490941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1806060492", "metadata": {"Type": "work"}}} Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:22:18.492544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1806060492', 'metadata': {'Type': 'work'}}}} Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.493541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:22:18.495116 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:22:18.496854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 13:22:18.496854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.496854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-83699342-596a-4b65-bf19-2a08a77eeb58 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.496854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-83699342-596a-4b65-bf19-2a08a77eeb58 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143814 Jun 07 13:22:18.496854 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 508/1020] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jun 7 13:22:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:18.502366 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-953045e1-a119-43fa-832f-81e23ab14a29 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Action: 'create', calling method: .version_select at 0x7f20a483d430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1687390895", "metadata": {"Type": "work"}}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-953045e1-a119-43fa-832f-81e23ab14a29 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 120 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:18.505704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1687390895", "metadata": {"Type": "work"}}} Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: Jun 07 13:22:18.507304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1687390895', 'metadata': {'Type': 'work'}}}} Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi '0' Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.508241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:22:18.509943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:22:18.511539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 13:22:18.511539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.511539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-953045e1-a119-43fa-832f-81e23ab14a29 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.511539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-953045e1-a119-43fa-832f-81e23ab14a29 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008776 Jun 07 13:22:18.511539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 513/1021] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jun 7 13:22:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:18.516657 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-95f7c5f1-8c80-4f8a-8419-dc239d372403 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Action: 'create', calling method: .version_select at 0x7f20a4689670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1617575472", "metadata": {"Type": "work"}}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-95f7c5f1-8c80-4f8a-8419-dc239d372403 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 119 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:22:18.519022 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1617575472", "metadata": {"Type": "work"}}} Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:22:18.520569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1617575472', 'metadata': {'Type': 'work'}}}} Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise error Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi '' Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.521604 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 13:22:18.523207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 13:22:18.524920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 13:22:18.524920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.524920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-95f7c5f1-8c80-4f8a-8419-dc239d372403 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.524920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-95f7c5f1-8c80-4f8a-8419-dc239d372403 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007511 Jun 07 13:22:18.524920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 509/1022] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jun 7 13:22:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:18.535602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2806e2b-be5f-4fe8-af90-a2410bab63ef tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Calling method '.version_select at 0x7f20a65f45e0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.577832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-f2806e2b-be5f-4fe8-af90-a2410bab63ef tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] HTTP exception thrown: Volume tempest-invalid-2119970344 could not be found. Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2806e2b-be5f-4fe8-af90-a2410bab63ef tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2119970344 HTTP/1.1 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:18.580112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Volume tempest-invalid-2119970344 could not be found. Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'tempest-invalid-2119970344'} Jun 07 13:22:18.581592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2119970344 could not be found. (HTTP 404) (Request-ID: req-afaf4408-1359-41d8-8f5e-27611973bb5b) Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.582428 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:22:18.583846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2119970344 could not be found. Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:18.585401 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2119970344 could not be found. Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2119970344 could not be found. Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f2806e2b-be5f-4fe8-af90-a2410bab63ef tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 404 to user: Volume tempest-invalid-2119970344 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f2806e2b-be5f-4fe8-af90-a2410bab63ef tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2119970344" status: 404 len: 99 microversion: 2.1 time: 0.054620 Jun 07 13:22:18.587052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 514/1023] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jun 7 13:22:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2119970344 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 13:22:18.593883 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e12d5bf9-43f7-4859-9d50-1af7a544a15e tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005454 Jun 07 13:22:18.594385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 510/1024] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jun 7 13:22:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 13:22:18.603035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1ec3101a-1580-4d05-b92c-e73f2258b860 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003827 Jun 07 13:22:18.603516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 515/1025] 10.222.0.20 () {58 vars in 1136 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 07 13:22:18.612029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a70a872a-49fa-4ff7-a60f-c2e6bfde4a3f tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Calling method '.version_select at 0x7f20a47d2430>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.640198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-a70a872a-49fa-4ff7-a60f-c2e6bfde4a3f tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] HTTP exception thrown: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a70a872a-49fa-4ff7-a60f-c2e6bfde4a3f tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: DELETE /compute/v2.1/os-volumes/41fe2a7f-a8bc-407b-818a-9973cb6b8668 HTTP/1.1 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:22:18.642198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '41fe2a7f-a8bc-407b-818a-9973cb6b8668'} Jun 07 13:22:18.643742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. (HTTP 404) (Request-ID: req-5b172b91-f073-442e-8c7e-509975849df9) Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.644589 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 13:22:18.645903 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 13:22:18.647343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a70a872a-49fa-4ff7-a60f-c2e6bfde4a3f tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 404 to user: Volume 41fe2a7f-a8bc-407b-818a-9973cb6b8668 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a70a872a-49fa-4ff7-a60f-c2e6bfde4a3f tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/41fe2a7f-a8bc-407b-818a-9973cb6b8668" status: 404 len: 109 microversion: 2.1 time: 0.035495 Jun 07 13:22:18.649122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 511/1026] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:22:18 2022] DELETE /compute/v2.1/os-volumes/41fe2a7f-a8bc-407b-818a-9973cb6b8668 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:18.653730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f4e7db-f0a6-42fb-9594-5cfbcbd22320 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Calling method '.version_select at 0x7f20a4949a60>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:18.681439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-04f4e7db-f0a6-42fb-9594-5cfbcbd22320 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] HTTP exception thrown: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f4e7db-f0a6-42fb-9594-5cfbcbd22320 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Request method failure captured: Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/os-volumes/8943da59-9dcb-4834-9e72-c6778a4f0323 HTTP/1.1 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1EKoeUc6hB8uEqTqZHXuYZSaG1gILPJ_JOzS3vJbLKggM70Oh5sHIjJLa4c_ICaIXziVDqbMIQcbyEMMYY0E5HC2LeUW6w_ceIgaLl8xcGNwvmi5dPViAeAXosoDERjhr9wBu6CSANLVMplNF2PkB7GFOE2FvWTEhtVgaB0kOMHbrw Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:18.683377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d70ccd8f292d4a24a558fd45fc203622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: d70ccd8f292d4a24a558fd45fc203622 Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-VolumesNegativeTest-1412860695 Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 774fd3235cbd492a9c987284d668240d Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-VolumesNegativeTest-1412860695-project Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '8943da59-9dcb-4834-9e72-c6778a4f0323'} Jun 07 13:22:18.684785 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. (HTTP 404) (Request-ID: req-a2c5c632-91d2-41d2-908a-f646fe7db55b) Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.686531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 13:22:18.687843 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 13:22:18.689050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-04f4e7db-f0a6-42fb-9594-5cfbcbd22320 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] Returning 404 to user: Volume 8943da59-9dcb-4834-9e72-c6778a4f0323 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-04f4e7db-f0a6-42fb-9594-5cfbcbd22320 tempest-VolumesNegativeTest-1412860695 tempest-VolumesNegativeTest-1412860695-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8943da59-9dcb-4834-9e72-c6778a4f0323" status: 404 len: 109 microversion: 2.1 time: 0.034863 Jun 07 13:22:18.690222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 516/1027] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jun 7 13:22:18 2022] GET /compute/v2.1/os-volumes/8943da59-9dcb-4834-9e72-c6778a4f0323 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:19.120112 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:19.120916 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:19.129277 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.129726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.130631 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:19.131068 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:19.358632 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:19.362778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:19.373560 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e006e874-932d-4ebd-8bff-56a949c147e7 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.257300 Jun 07 13:22:19.374204 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 512/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:19 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:20.396007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:20.396647 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:20.403060 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.403545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.404916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:20.405382 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:20.545762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:20.553824 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7080297f-d961-4c3c-987b-37bc4e816c2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.165946 Jun 07 13:22:20.554384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 517/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:20 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:21.571442 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:21.572044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:21.574439 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:21.575096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=8 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:21.583414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.583866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.584640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:21.585198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:21.726436 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:21.734882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eba7273c-549c-4a45-b027-af0fac82fb7b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.167402 Jun 07 13:22:21.735490 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 513/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:21 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:22.753241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:22.753857 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:22.764569 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.765104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.765921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:22.766356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:22.911061 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:22.914829 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=100 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:22.920055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-481482f2-caa1-4020-9b0f-35260d8cf293 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.171605 Jun 07 13:22:22.920787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 518/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:22 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:23.937646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:23.938393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:23.940745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:23.946155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:23.946606 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:23.947378 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:23.947799 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.099369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:24.107396 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-73bcd759-eea2-4406-a8cb-5d93649fc4b6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.173927 Jun 07 13:22:24.107989 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 514/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:23 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:22:24.852528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-fe2c1ea4-efda-476c-8000-3c23098d4bc1 req-d8fb08a9-b4a2-4dbc-8350-364ecc38b630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "name": "network-vif-plugged", "status": "completed", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:24.857140 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:24.864871 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fe2c1ea4-efda-476c-8000-3c23098d4bc1 req-d8fb08a9-b4a2-4dbc-8350-364ecc38b630 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:24.865781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fe2c1ea4-efda-476c-8000-3c23098d4bc1 req-d8fb08a9-b4a2-4dbc-8350-364ecc38b630 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:24.881308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-fe2c1ea4-efda-476c-8000-3c23098d4bc1 req-d8fb08a9-b4a2-4dbc-8350-364ecc38b630 service nova] Creating event network-vif-plugged:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:22:24.886854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-fe2c1ea4-efda-476c-8000-3c23098d4bc1 req-d8fb08a9-b4a2-4dbc-8350-364ecc38b630 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037890 Jun 07 13:22:24.887524 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 519/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:22:25.124626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:25.125227 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:25.132386 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.132828 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.133634 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:25.134072 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:25.273824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:25.281875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-22d24e38-9501-4bab-964a-d65f8d91db52 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.161469 Jun 07 13:22:25.282477 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 515/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:25 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:26.301735 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:26.302597 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:26.311309 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.311849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.312832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:26.313441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:26.459729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:26.467772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ebb8854f-eeed-45bc-b4d2-4e455814ceba tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.171309 Jun 07 13:22:26.468350 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 520/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:26 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:27.487655 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:27.488293 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:27.495785 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.496228 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.496984 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:27.497444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:27.649769 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:27.658642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1e9411ca-2540-4e38-a000-5aa274e85275 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.175889 Jun 07 13:22:27.659257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 516/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:27 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:28.677120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:28.677746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:28.684488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.684940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.685736 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:28.686174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:28.823583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:28.831775 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2ef437e3-a046-42d7-af56-6c002f42a274 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.159410 Jun 07 13:22:28.832353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 521/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:28 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:29.849780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:29.850345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:29.857357 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.857801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:29.858554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:29.858982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:30.026437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:30.034362 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6d0a750-956d-441b-9ab5-7f394a891901 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.188449 Jun 07 13:22:30.034957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 517/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:29 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:31.055967 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:31.056548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:31.063528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.063982 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.064761 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:31.065241 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:31.204900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:31.213127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-59a8430e-6529-44b2-b6ed-783782fff03b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1264 microversion: 2.1 time: 0.161109 Jun 07 13:22:31.213846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 522/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:31 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:32.230196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:32.230894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:32.237948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.238500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.239302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.239735 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.377537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:32.389702 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b45e800c-7a1e-4985-a03b-1dc9a3ffc7ff tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1451 microversion: 2.1 time: 0.163423 Jun 07 13:22:32.390482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 518/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:32 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:32.415525 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:32.416125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:32.426318 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.426830 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.427935 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:32.428432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:32.567479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:32.577032 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b3405fc0-5ca6-48a5-9f11-4dd7678c3862 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1451 microversion: 2.1 time: 0.167603 Jun 07 13:22:32.577621 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 523/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:32 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:34.410783 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-6d8a2be7-fde0-4573-baa9-7b638460846b req-899a0922-d140-4634-984b-778f773d88ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:34.424627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6d8a2be7-fde0-4573-baa9-7b638460846b req-899a0922-d140-4634-984b-778f773d88ea service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:34.424627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-6d8a2be7-fde0-4573-baa9-7b638460846b req-899a0922-d140-4634-984b-778f773d88ea service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:34.434419 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-6d8a2be7-fde0-4573-baa9-7b638460846b req-899a0922-d140-4634-984b-778f773d88ea service nova] Creating event network-changed:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:22:34.439784 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-6d8a2be7-fde0-4573-baa9-7b638460846b req-899a0922-d140-4634-984b-778f773d88ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033266 Jun 07 13:22:34.440389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 519/1042] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:42.506229 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c714af7-cfc2-42a3-8a7a-5988f26e7f1a", "device": "/dev/sdb"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:42.507800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:42.510002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=9 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:42.515611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:42.516056 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:42.517526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:42.517526 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:42.786888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-40f43b1b-b17e-4a94-a201-0903b353f148 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "POST /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284768 Jun 07 13:22:42.787519 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 524/1043] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:22:42 2022] POST /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:48.167885 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:48.168488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.173587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=11 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:48.174270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=38 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:48.180813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.181282 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.182067 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.182618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.206438 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-604b4a78-c330-4b7c-8e24-aaa046968431 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/ips" status: 200 len: 150 microversion: 2.1 time: 0.042885 Jun 07 13:22:48.207100 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 520/1044] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:22:48 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:48.218510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a77fb1fb-6a43-40a9-9618-fc7b72ca5421"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:48.219706 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.226048 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.226498 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.227264 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.227715 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.314900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/os-volume_attachments HTTP/1.1 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 74 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:48.316640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {"volumeAttachment": {"volumeId": "a77fb1fb-6a43-40a9-9618-fc7b72ca5421"}} Jun 07 13:22:48.318304 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '3e7fcb9a-d081-447d-bb1e-02f1f08b3f71', 'body': {'volumeAttachment': {'volumeId': 'a77fb1fb-6a43-40a9-9618-fc7b72ca5421'}}} Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:48.319138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:48.320483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 400 to user: Invalid volume: volume a77fb1fb-6a43-40a9-9618-fc7b72ca5421 is already attached to instances: ff5f1573-0c99-4a11-a312-4736459f884e {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-be6f4e1b-44dd-4d96-bb19-cdf374cf92fc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104475 Jun 07 13:22:48.321833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 525/1045] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:22:48 2022] POST /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 13:22:48.327094 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:48.327603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.333878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.334334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.335101 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.335538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.361026 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:22:48.439835 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a0b18a82-e6b2-4deb-b7e5-55a964b302f0 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 204 len: 0 microversion: 2.1 time: 0.116323 Jun 07 13:22:48.441420 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 521/1046] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:22:48 2022] DELETE /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:22:48.450414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:48.451071 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:48.459161 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.459620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.460464 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:48.460940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:48.603998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:48.613901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1a00f154-306f-4f6f-b508-1ba92a876adf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1683 microversion: 2.1 time: 0.167745 Jun 07 13:22:48.614486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 526/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:48 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:49.632628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:49.633370 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:49.640304 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.640681 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.641487 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:49.641921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:49.787051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:49.795095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3168378-88c2-4f0c-8088-531242c6e2e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1683 microversion: 2.1 time: 0.166756 Jun 07 13:22:49.795656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 522/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:49 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:50.814472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:50.815867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:50.822665 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.823113 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:50.823897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:50.824334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:50.965045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:50.972836 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-dcc56a30-67e1-42f4-be9e-3db7a14113d2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1683 microversion: 2.1 time: 0.164618 Jun 07 13:22:50.973419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 527/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:50 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:51.989511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:51.990481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:51.997684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:51.998157 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:51.998907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:51.999326 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:52.067016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:52.074906 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d84baec2-99f4-4af6-8f31-0596ed1b7758 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1615 microversion: 2.1 time: 0.089379 Jun 07 13:22:52.075456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 523/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:51 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:52.232068 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2fdf7dab-b6c6-4a47-bf74-f8a4c155e97e req-a731c48c-f2a2-4f45-a700-6c499df8faa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e7fcb9a-d081-447d-bb1e-02f1f08b3f71", "name": "network-vif-deleted", "tag": "25fbe4e1-c87b-44b0-8640-68e8e31b01fe"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:22:52.241837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2fdf7dab-b6c6-4a47-bf74-f8a4c155e97e req-a731c48c-f2a2-4f45-a700-6c499df8faa5 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:52.242285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2fdf7dab-b6c6-4a47-bf74-f8a4c155e97e req-a731c48c-f2a2-4f45-a700-6c499df8faa5 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:52.259424 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2fdf7dab-b6c6-4a47-bf74-f8a4c155e97e req-a731c48c-f2a2-4f45-a700-6c499df8faa5 service nova] Creating event network-vif-deleted:25fbe4e1-c87b-44b0-8640-68e8e31b01fe for instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 on hv-cinder-84496 Jun 07 13:22:52.265111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2fdf7dab-b6c6-4a47-bf74-f8a4c155e97e req-a731c48c-f2a2-4f45-a700-6c499df8faa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037020 Jun 07 13:22:52.265797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 528/1051] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:53.092352 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:53.092920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:53.102203 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.102645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.103414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:53.103878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:53.179519 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:53.187778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b29c58c8-f52e-49a0-b520-991b64920e1f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1615 microversion: 2.1 time: 0.099452 Jun 07 13:22:53.188375 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 524/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:53 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1615 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:54.206859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:54.207442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:54.215034 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.215471 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.216252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:54.216681 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:54.281653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:54.289766 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-64162794-3533-4292-b727-d2bd0c2dd636 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1615 microversion: 2.1 time: 0.087329 Jun 07 13:22:54.290385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 529/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:54 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:55.306652 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:55.307309 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:55.314297 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.314758 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.315714 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.316185 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.350965 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:55.351418 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:55.351873 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lazy-loading 'fault' on Instance uuid 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:55.394106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:22:55.402590 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-41a76d1d-374f-42cb-b251-69f1aae9a6a4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 200 len: 1332 microversion: 2.1 time: 0.099908 Jun 07 13:22:55.403087 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 525/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:55 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:22:56.420047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:56.420661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:56.428966 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.429473 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.430266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:56.430705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:56.433601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:22:56.449253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 HTTP/1.1 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:22:56.451143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:22:56.452676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '3e7fcb9a-d081-447d-bb1e-02f1f08b3f71'} Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:22:56.453629 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:22:56.455128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:22:56.456448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:22:56.456448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d2e8db77-5472-46d8-a841-0a154a0f3967 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 404 len: 111 microversion: 2.1 time: 0.037954 Jun 07 13:22:56.459016 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 530/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:22:56 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:22:56.464101 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d6bf9b45-9dc5-439a-a05d-c38d3a9a2cd8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '.version_select at 0x7f20a4689160>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:56.483761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d6bf9b45-9dc5-439a-a05d-c38d3a9a2cd8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919865530" status: 202 len: 0 microversion: 2.1 time: 0.023551 Jun 07 13:22:56.484349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 526/1056] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jun 7 13:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919865530 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:57.187870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:57.188370 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:57.195350 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.195808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.196594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.197063 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.283881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lazy-loading 'services' on Instance uuid ff5f1573-0c99-4a11-a312-4736459f884e {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:22:57.362601 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2d5021fe-7707-4b6b-87af-06c04071484c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments/a77fb1fb-6a43-40a9-9618-fc7b72ca5421" status: 202 len: 0 microversion: 2.1 time: 0.178904 Jun 07 13:22:57.363320 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 531/1057] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:22:57 2022] DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments/a77fb1fb-6a43-40a9-9618-fc7b72ca5421 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:22:57.375313 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:57.376889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:57.384780 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.385264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.386046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:57.386468 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:57.416012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31a432c3-c0b1-469d-bdf8-f478f5685be3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Jun 07 13:22:57.416586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 527/1058] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:57 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:58.429680 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:58.430729 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:58.439980 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.440429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.441781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:58.442476 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:58.476433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cbfa97c6-446a-4bf2-bbc9-0bbfc8d9d282 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052232 Jun 07 13:22:58.477035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 532/1059] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:58 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:22:59.488323 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:22:59.489390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:22:59.497401 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.497912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.498730 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:22:59.499158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:22:59.532093 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f34d559-7955-4f1d-b7fe-8bbcdb0d3506 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Jun 07 13:22:59.532740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 528/1060] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:22:59 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:00.544085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:00.545039 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:00.552055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.552504 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.553313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:00.553742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:00.584094 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0a2c5f78-ad22-45f9-9b01-3dec5bd1c7f1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Jun 07 13:23:00.584664 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 533/1061] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:00 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:01.596406 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:01.597826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:01.605821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.606340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.607316 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.607741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.643859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d9b647f-80d5-41ea-b40f-68ed3f6fda53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051472 Jun 07 13:23:01.644339 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 529/1062] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:23:01 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:23:01.705717 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:01.706298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:01.713047 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.713506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.714281 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.714712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.741860 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:01.824359 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2d901e8b-f595-4c87-b6e4-1acdd125ff01 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 204 len: 0 microversion: 2.1 time: 0.122119 Jun 07 13:23:01.825417 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 534/1063] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:01 2022] DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:23:01.835405 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:01.836044 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:01.843949 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.844398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:01.845265 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:01.845704 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:02.013112 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:02.022256 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f19891d6-1575-4522-a00b-0aa76d375d9c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.191386 Jun 07 13:23:02.022934 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 530/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:01 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:03.040739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:03.041466 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:03.048492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.048970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.049755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:03.050204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:03.202900 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:03.210876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bc37a8c6-9413-48fb-8a90-7f3656eaec14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.174408 Jun 07 13:23:03.211692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 535/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:03 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:04.228904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:04.229568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:04.235664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.236122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.236898 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:04.237372 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:04.380082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:04.388445 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-93763536-52e0-47ac-9277-b79b8a2a7284 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.164044 Jun 07 13:23:04.389057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 531/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:04 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:05.406672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:05.407283 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:05.415606 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.416056 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.416828 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:05.417565 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:05.562261 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:05.570164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9be3d257-266b-4327-8bed-164a42203986 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.167599 Jun 07 13:23:05.570709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 536/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:05 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:06.588414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:06.588979 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:06.596538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.597278 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.598599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:06.599042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:06.741087 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:06.749392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2dd1f941-6955-4616-b28c-a3b1e541a791 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.165013 Jun 07 13:23:06.749976 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 532/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:06 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:07.767254 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:07.767848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:07.775143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:07.775591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.776437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:07.776868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:07.914441 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:07.922374 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-337fdb6c-8afb-4294-ab39-34968b89672c tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1681 microversion: 2.1 time: 0.159109 Jun 07 13:23:07.923002 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 537/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:07 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:08.515029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-30294361-650a-4343-bc8b-b01eafbd7a33 req-47f49dc6-d67b-40b7-ac4d-cf5324799531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5f1573-0c99-4a11-a312-4736459f884e", "name": "network-vif-deleted", "tag": "84dfabf1-b526-43a9-a66a-269225470295"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:08.528816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-30294361-650a-4343-bc8b-b01eafbd7a33 req-47f49dc6-d67b-40b7-ac4d-cf5324799531 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.529520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-30294361-650a-4343-bc8b-b01eafbd7a33 req-47f49dc6-d67b-40b7-ac4d-cf5324799531 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.545276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-30294361-650a-4343-bc8b-b01eafbd7a33 req-47f49dc6-d67b-40b7-ac4d-cf5324799531 service nova] Creating event network-vif-deleted:84dfabf1-b526-43a9-a66a-269225470295 for instance ff5f1573-0c99-4a11-a312-4736459f884e on hv-cinder-84496 Jun 07 13:23:08.551847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-30294361-650a-4343-bc8b-b01eafbd7a33 req-47f49dc6-d67b-40b7-ac4d-cf5324799531 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041341 Jun 07 13:23:08.559794 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 533/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:08.940136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:08.940904 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:08.947928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.948534 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:08.949177 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:08.949594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:09.020622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:09.028772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bb8dacee-7574-450f-aa0d-6ac4207d8a45 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1614 microversion: 2.1 time: 0.092602 Jun 07 13:23:09.029392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 538/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:08 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:10.048395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:10.049102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:10.056140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.056587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.057407 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:10.057842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:10.123387 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:10.131825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ff5f3fb0-796a-48f1-8d2a-41df1edcd919 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1327 microversion: 2.1 time: 0.088489 Jun 07 13:23:10.132397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 534/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:10 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:11.149446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:11.150077 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:11.157568 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.158017 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.158793 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:11.159211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:11.232273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:11.243211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ecfe53ad-6006-4368-8085-6c250470e7dd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1327 microversion: 2.1 time: 0.097755 Jun 07 13:23:11.243794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 539/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:11 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:12.260573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:12.261270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:12.268460 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.268957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.269865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.270355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.302218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:12.302709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:12.303233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lazy-loading 'fault' on Instance uuid ff5f1573-0c99-4a11-a312-4736459f884e {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:12.345554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:12.353680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e4bcf9fb-8c21-4b6c-908c-18ef6c7769ab tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 200 len: 1332 microversion: 2.1 time: 0.097376 Jun 07 13:23:12.354312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 535/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:12 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:13.373155 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:13.373819 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:13.376407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:13.383712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.384204 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.384995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:13.389419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:13.402288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e HTTP/1.1 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:23:13.403959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:23:13.405577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ff5f1573-0c99-4a11-a312-4736459f884e'} Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:13.406353 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:23:13.408760 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:23:13.410771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:13.410771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8fec0da7-e815-474f-9b70-4f217bfe0fda tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 404 len: 111 microversion: 2.1 time: 0.037395 Jun 07 13:23:13.410771 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 540/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:13 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:23:13.421592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-bfa2c40f-6e25-4ea7-965e-1f067462986f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '.version_select at 0x7f20a48735e0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:13.445879 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-bfa2c40f-6e25-4ea7-965e-1f067462986f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995624954" status: 202 len: 0 microversion: 2.1 time: 0.030195 Jun 07 13:23:13.449820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 536/1076] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jun 7 13:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995624954 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 13:23:14.322838 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-cffb587a-7760-479b-bbff-3c21225c6f88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: .version_select at 0x7f20a48713a0>, body: {"keypair": {"name": "tempest-keypair-1165938237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSJSgl8RulnxmNNqqDAVpZoWkm89Kv/26OCCfia15TPzHWBOrVDAmzgIX73kk4Cok2QJP5vj9ryNr8wVx28Km2aYAcAmGw7cKlBNhFpFBk3Nk34CY18DzQly3qY7xjACA=="}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:14.339721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-cffb587a-7760-479b-bbff-3c21225c6f88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:14.344331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-cffb587a-7760-479b-bbff-3c21225c6f88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:14.374965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-cffb587a-7760-479b-bbff-3c21225c6f88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057659 Jun 07 13:23:14.375722 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 541/1077] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:23:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:15.921162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834611990", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4c5b29e-534b-4458-943d-262c9e18bfb9"}], "security_groups": [{"name": "tempest-securitygroup--793969492"}], "key_name": "tempest-keypair-1165938237", "user_data": "}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:16.031462 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.032286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.036472 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.network.neutron [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] validate_networks() for [('a4c5b29e-534b-4458-943d-262c9e18bfb9', None, None, None, None, None)] {{(pid=117832) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:16.040425 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.040888 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.041753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.042201 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.138902 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lazy-loading 'services' on Instance uuid 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:23:16.225726 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a0a2b748-5e9c-44d3-89e6-226bcf8fcd1d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34/os-volume_attachments/0c714af7-cfc2-42a3-8a7a-5988f26e7f1a" status: 202 len: 0 microversion: 2.1 time: 0.199000 Jun 07 13:23:16.226747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 542/1078] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:23:16 2022] DELETE /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34/os-volume_attachments/0c714af7-cfc2-42a3-8a7a-5988f26e7f1a => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:23:16.589763 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:16.590198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image limits 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:16.590865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:16.591286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image pref 0:0:0 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:16.591691 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.virt.hardware [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:16.601545 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.601998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.602804 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:16.603245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:16.611833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:16.626140 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:16.630848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:16.643517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Going to run 1 instances... {{(pid=117832) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:16.646294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:16.696057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2ae079dd-b1fe-4a9b-a304-31d41f2e8223 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.779217 Jun 07 13:23:16.702239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 537/1079] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:23:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:23:16.711658 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7cc460e5-9cbe-49f1-a82a-a6ea4e5bd711 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:16.712366 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7cc460e5-9cbe-49f1-a82a-a6ea4e5bd711 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:16.791741 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7cc460e5-9cbe-49f1-a82a-a6ea4e5bd711 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:16.802990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7cc460e5-9cbe-49f1-a82a-a6ea4e5bd711 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1241 microversion: 2.1 time: 0.095673 Jun 07 13:23:16.804227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 543/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:16 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:17.420374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:17.421153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.430598 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.431096 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.431863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.432544 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.463945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:23:17.588919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-a8cc5efb-70d5-4532-83d7-40d7e140e174 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 204 len: 0 microversion: 2.1 time: 0.172936 Jun 07 13:23:17.589960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 538/1081] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:23:17 2022] DELETE /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:23:17.601502 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:17.602797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.613234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.613861 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.615122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.615634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.766705 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.774956 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bdc8f256-4381-4c83-bdfb-f1d56c594fd8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1513 microversion: 2.1 time: 0.179980 Jun 07 13:23:17.775544 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 544/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:17 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:17.821152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:17.821964 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:17.829708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.830144 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.831024 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:17.831844 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:17.901970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:17.910240 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-36102111-35e3-49dc-8c9a-9645aea3ee70 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1293 microversion: 2.1 time: 0.093373 Jun 07 13:23:17.910813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 539/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:17 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:18.792067 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:18.792642 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:18.799863 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.800617 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.801442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.801882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.928207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:18.929668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:18.932168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:18.938102 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.938543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.940089 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:18.940500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:18.948205 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:18.955990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f0c66995-2892-4ca5-82ac-481dc3758f19 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1513 microversion: 2.1 time: 0.167982 Jun 07 13:23:18.957215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 545/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:18 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:19.006268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:19.014079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a12620e-3a54-458f-886a-304a3b2b64d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1293 microversion: 2.1 time: 0.089957 Jun 07 13:23:19.014678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 540/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:18 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:19.974896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:19.975516 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:19.983377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.983817 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:19.984863 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:19.985342 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.037561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:20.039285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:20.048236 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.048774 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.049862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.050461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.060414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:20.070826 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-eb160d1a-6c61-4a89-b4a4-e1c17543246c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 200 len: 1471 microversion: 2.1 time: 0.100245 Jun 07 13:23:20.073488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 546/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:19 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 1471 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:20.138707 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:20.150056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aad6dc66-9b74-4b70-8678-6eccda79c470 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1299 microversion: 2.1 time: 0.121740 Jun 07 13:23:20.151712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 541/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:20 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:20.162284 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-0a32205d-f506-4705-8413-24af18d82b02 req-b427acc1-9bc6-4d9e-b5e9-91b4a1385a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34", "name": "network-vif-deleted", "tag": "76b17f72-75a0-4fd0-a6ad-39037ad41025"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:20.172510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0a32205d-f506-4705-8413-24af18d82b02 req-b427acc1-9bc6-4d9e-b5e9-91b4a1385a85 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:20.172969 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0a32205d-f506-4705-8413-24af18d82b02 req-b427acc1-9bc6-4d9e-b5e9-91b4a1385a85 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:20.177270 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:20.186654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-0a32205d-f506-4705-8413-24af18d82b02 req-b427acc1-9bc6-4d9e-b5e9-91b4a1385a85 service nova] Creating event network-vif-deleted:76b17f72-75a0-4fd0-a6ad-39037ad41025 for instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 on hv-cinder-84496 Jun 07 13:23:20.192793 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-0a32205d-f506-4705-8413-24af18d82b02 req-b427acc1-9bc6-4d9e-b5e9-91b4a1385a85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034324 Jun 07 13:23:20.196351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 547/1088] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:21.091584 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:21.092445 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:21.099533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.100226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.101390 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.102155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.126001 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] HTTP exception thrown: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Request method failure captured: Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 HTTP/1.1 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1DxsP-fXgVoZzJod9T8zQNwkefdielBJrtz4EuXRR8kTDnYTEMz7gRpE-EF_ec4yuvn0eV5m5G3H1O0m4BnPLiTL4n1MpjAXHRv13kp3Qeqim_I8EerlKu3ZWCzb5PIXJRwGmAfrdnaT85dH-n48vRpNhZ11y6BLflCRRr4jfdIHac Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: dbeb18fed89a458e9ba2a998a73fe899 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:23:21.128349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: dbeb18fed89a458e9ba2a998a73fe899 Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotTestJSON-936303282-project Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 6ccfbda39c494fcfadded542666d3df3 Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotTestJSON-936303282-project Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. Jun 07 13:23:21.130234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34'} Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:23:21.131083 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. Jun 07 13:23:21.132473 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:23:21.134858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Returning 404 to user: Instance 9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:23:21.134858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1934f97a-c309-4ce2-b956-b47a1ecc7a8f tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34" status: 404 len: 111 microversion: 2.1 time: 0.045622 Jun 07 13:23:21.136969 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 542/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:21 2022] GET /compute/v2.1/servers/9e7e5cb7-cd32-45f3-bb36-76b5cd39fb34 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:23:21.169870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:21.170589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:21.180479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.181375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.182467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.183073 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.394324 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:21.408345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7b42c7ac-b7c1-4352-8304-3d6197868f98 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.243769 Jun 07 13:23:21.408938 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 548/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:21 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:21.816098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-9d573cc2-6448-44bd-b78b-50a2e6003ea3 req-d1a67d50-fa18-4509-882a-74ea5c83bd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12378db2-7d47-48c5-bec0-3ca2b6ea9b15", "tag": "bcc5093c-262c-4411-ac1b-8e1c899a4271"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:21.857950 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9d573cc2-6448-44bd-b78b-50a2e6003ea3 req-d1a67d50-fa18-4509-882a-74ea5c83bd5e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:21.858933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-9d573cc2-6448-44bd-b78b-50a2e6003ea3 req-d1a67d50-fa18-4509-882a-74ea5c83bd5e service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:21.886962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-9d573cc2-6448-44bd-b78b-50a2e6003ea3 req-d1a67d50-fa18-4509-882a-74ea5c83bd5e service nova] Creating event network-changed:bcc5093c-262c-4411-ac1b-8e1c899a4271 for instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 on hv-cinder-84496 Jun 07 13:23:21.895245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-9d573cc2-6448-44bd-b78b-50a2e6003ea3 req-d1a67d50-fa18-4509-882a-74ea5c83bd5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083538 Jun 07 13:23:21.896567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 543/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:22.425881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:22.426505 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:22.435891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:22.436384 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:22.437407 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:22.437661 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:22.597612 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:22.606288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0c389686-dd13-473f-b880-661ceb9022ad tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.184318 Jun 07 13:23:22.616008 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 549/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:22 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:23.625273 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:23.625962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:23.633300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:23.633740 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:23.634517 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:23.634944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:23.777823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:23.786169 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-623da6c8-d810-4fda-b916-e32b2dc1bfef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.165129 Jun 07 13:23:23.786890 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 544/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:23 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:24.803809 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:24.804408 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:24.811547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.811994 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:24.812744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:24.813229 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:25.245611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:25.253346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0dd391e0-c716-4a07-bbfd-ab610a7917ea tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.453668 Jun 07 13:23:25.253930 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 550/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:24 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:26.270887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:26.271588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:26.278514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:26.278963 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:26.279738 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:26.280250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:26.428349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:26.436949 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-be422e4c-15bd-4384-a7f9-fff448b763d5 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.170097 Jun 07 13:23:26.437708 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 545/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:26 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:27.455236 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:27.455881 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:27.458853 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:27.464786 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.465262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.466031 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:27.466454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:27.599165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:27.608442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-229f411d-e3aa-4678-825a-8d31da3fe215 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.157113 Jun 07 13:23:27.615921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 551/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:27 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:28.630525 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:28.631186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:28.633322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=2 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:28.634016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:28.640904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.641374 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.642175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:28.642605 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:28.795660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:28.804824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d4e8e7c8-f3d1-4879-941e-33ab06444b41 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.180543 Jun 07 13:23:28.805449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 546/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:28 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:29.822354 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:29.822984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:29.830529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.831053 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:29.832086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:29.832552 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:30.008890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:30.018555 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3376d421-937f-4b33-bc77-fb89e450f9e6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.200141 Jun 07 13:23:30.020965 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 552/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:29 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:31.038617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:31.039529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:31.047012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.047464 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.048305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:31.048791 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:31.226175 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:31.234214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-09704f2e-3a6d-4589-8cd9-cc7381c848e9 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.199759 Jun 07 13:23:31.234823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 547/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:31 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:32.252439 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:32.253187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:32.260563 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.261258 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.261899 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:32.262335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:32.430203 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:32.440840 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-da8edf1d-209c-4281-a379-2cbc69de4895 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.191950 Jun 07 13:23:32.441676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 553/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:32 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:33.469250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:33.470335 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:33.482340 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.483032 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.484342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:33.485120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:33.651371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:33.659106 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8e9e007a-9878-4a9c-b4b4-870c77a6face tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.196860 Jun 07 13:23:33.659678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 548/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:33 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:34.677586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:34.678286 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:34.685431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.685882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.686679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:34.687125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:34.842581 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:34.850648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-0435989d-290e-46a8-84fa-25c134167b53 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.177652 Jun 07 13:23:34.851237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 554/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:34 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:35.874133 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:35.874975 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:35.885552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.886246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:35.887449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:35.888110 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:36.161966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:36.171639 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e107e33f-b145-4807-b462-85f820689aa8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.304232 Jun 07 13:23:36.172226 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 549/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:35 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:36.570414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-978284383", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "networks": [{"uuid": "f9d8fcd0-2d1c-4967-88d7-db3bf160bc9c"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:36.640491 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] validate_networks() for [('f9d8fcd0-2d1c-4967-88d7-db3bf160bc9c', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:23:37.198080 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:37.201816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:37.212079 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.212663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.213456 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.214187 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.260028 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:23:37.260445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:23:37.260916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:23:37.261346 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:23:37.261752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:23:37.276850 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.277643 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.279175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:37.279944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:37.310995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Getting quotas for project dbeb18fed89a458e9ba2a998a73fe899. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:23:37.319833 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Getting quotas for user 6ccfbda39c494fcfadded542666d3df3 and project dbeb18fed89a458e9ba2a998a73fe899. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:23:37.344255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:23:37.344848 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:23:37.423504 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.431932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e62545db-98e3-4d0c-83ae-64d78908ed1c tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865157 Jun 07 13:23:37.440852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 555/1104] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 13:23:37.444444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cabab2f4-a080-408b-a7b1-252d6f443567 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.252959 Jun 07 13:23:37.445367 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 550/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:37 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:37.452878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-717e87f2-31c5-4d72-9ca5-c6da94ad1257 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:37.453981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-717e87f2-31c5-4d72-9ca5-c6da94ad1257 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:37.539510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-717e87f2-31c5-4d72-9ca5-c6da94ad1257 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:37.547416 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-717e87f2-31c5-4d72-9ca5-c6da94ad1257 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1218 microversion: 2.1 time: 0.102447 Jun 07 13:23:37.548000 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 556/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:37 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:38.256522 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-3df70639-d122-4a0e-892a-6034c5c6c074 req-01429124-5abc-47de-9fb6-9923f8d5d215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12378db2-7d47-48c5-bec0-3ca2b6ea9b15", "name": "network-vif-plugged", "status": "completed", "tag": "bcc5093c-262c-4411-ac1b-8e1c899a4271"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:38.269483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3df70639-d122-4a0e-892a-6034c5c6c074 req-01429124-5abc-47de-9fb6-9923f8d5d215 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.270019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-3df70639-d122-4a0e-892a-6034c5c6c074 req-01429124-5abc-47de-9fb6-9923f8d5d215 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.282673 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-3df70639-d122-4a0e-892a-6034c5c6c074 req-01429124-5abc-47de-9fb6-9923f8d5d215 service nova] Creating event network-vif-plugged:bcc5093c-262c-4411-ac1b-8e1c899a4271 for instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 on hv-cinder-84496 Jun 07 13:23:38.288595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-3df70639-d122-4a0e-892a-6034c5c6c074 req-01429124-5abc-47de-9fb6-9923f8d5d215 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230120 Jun 07 13:23:38.289245 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 551/1107] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:23:38.467635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:38.468433 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:38.475062 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.475518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.476302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.476743 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.565198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:38.566117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:38.573045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.573508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.576893 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:38.577724 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:38.645510 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:38.657323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8322b4eb-b5fc-45e4-bee1-7c504156f62a tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.193362 Jun 07 13:23:38.658343 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 557/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:38 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:38.694392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:38.710095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c7674bda-e693-4295-bd1c-045c0889336d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1270 microversion: 2.1 time: 0.149109 Jun 07 13:23:38.711428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 552/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:38 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:39.680496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:39.681267 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:39.691262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:39.691709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:39.692514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:39.692978 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:39.736553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:39.737505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:39.744864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:39.745570 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:39.746208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:39.746673 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:39.875869 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:39.887778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2c29e6dd-c723-4cbe-a3a9-1ad1be94f207 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1366 microversion: 2.1 time: 0.212828 Jun 07 13:23:39.888678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 558/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:39 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:39.918127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:39.930812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ceeac24b-7534-4fe4-b247-0f603f9ddbb2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.197757 Jun 07 13:23:39.931914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 553/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:39 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:40.815349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-9e03a57b-29b5-4afe-93e9-624c97960795 req-ed9c6468-f5a0-4b54-8711-4fbabbe55368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e114e3-a152-4d83-956e-cb6dcd04ce2c", "tag": "0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:40.830237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9e03a57b-29b5-4afe-93e9-624c97960795 req-ed9c6468-f5a0-4b54-8711-4fbabbe55368 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.830747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-9e03a57b-29b5-4afe-93e9-624c97960795 req-ed9c6468-f5a0-4b54-8711-4fbabbe55368 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.843215 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-9e03a57b-29b5-4afe-93e9-624c97960795 req-ed9c6468-f5a0-4b54-8711-4fbabbe55368 service nova] Creating event network-changed:0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d for instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c on hv-cinder-84496 Jun 07 13:23:40.849791 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-9e03a57b-29b5-4afe-93e9-624c97960795 req-ed9c6468-f5a0-4b54-8711-4fbabbe55368 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039970 Jun 07 13:23:40.850472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 559/1112] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:40.910568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:40.911286 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:40.918107 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.918558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.919342 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.919782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.951085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:40.952100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:40.959538 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.960076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:40.960936 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:40.961506 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.162742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:41.172171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ba6107e6-17ea-42df-b08d-44802be09039 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.225288 Jun 07 13:23:41.172778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 560/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:40 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:41.206180 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:41.212028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:41.217138 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9c921ad4-482d-4b2f-8f78-3cc579ee9163 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1557 microversion: 2.1 time: 0.311009 Jun 07 13:23:41.217743 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 554/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:40 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1557 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:41.236172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:41.236676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:41.247559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.248351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.249923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:41.250730 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:41.353618 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-efc8f138-f81c-4a73-a6fc-59f0221ae422 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120925 Jun 07 13:23:41.354683 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 561/1115] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:23:41 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:42.194919 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:42.195998 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:42.210004 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.210771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.212118 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.212863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.426699 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:42.439171 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5106f50e-7e1e-4641-9b31-80edaac459df tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.251097 Jun 07 13:23:42.440671 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 555/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:42 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:42.635928 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-745a0081-ed88-4059-b035-2c64f51ed004 req-5b3951b6-4eec-4b96-a234-fb43ec940af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12378db2-7d47-48c5-bec0-3ca2b6ea9b15", "tag": "bcc5093c-262c-4411-ac1b-8e1c899a4271"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:42.645803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-745a0081-ed88-4059-b035-2c64f51ed004 req-5b3951b6-4eec-4b96-a234-fb43ec940af9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:42.646253 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-745a0081-ed88-4059-b035-2c64f51ed004 req-5b3951b6-4eec-4b96-a234-fb43ec940af9 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:42.658072 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-745a0081-ed88-4059-b035-2c64f51ed004 req-5b3951b6-4eec-4b96-a234-fb43ec940af9 service nova] Creating event network-changed:bcc5093c-262c-4411-ac1b-8e1c899a4271 for instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 on hv-cinder-84496 Jun 07 13:23:42.665479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-745a0081-ed88-4059-b035-2c64f51ed004 req-5b3951b6-4eec-4b96-a234-fb43ec940af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113176 Jun 07 13:23:42.666098 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 562/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:43.464594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:43.465723 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:43.475846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:43.476291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:43.477248 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:43.478015 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:43.669250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:43.683469 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-31bbf3a0-7ab0-45d2-9cbc-4a9bd3e4cf8d tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.223222 Jun 07 13:23:43.684542 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 556/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:43 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:44.708451 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:44.709600 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:44.713795 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:44.724159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:44.724972 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:44.726413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:44.727167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:44.894145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:44.902431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6a91658-e705-4700-905b-3fd38d6cf3ca tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.201208 Jun 07 13:23:44.903165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 563/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:44 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:45.924889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:45.925680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:45.933752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:45.934196 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:45.935043 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:45.935479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:46.173259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:46.183299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d580f9da-5428-46f8-b222-a085267dd6da tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.264354 Jun 07 13:23:46.184439 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 557/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:45 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:47.208551 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:47.209468 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:47.216634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.217188 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.218009 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:47.218484 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:47.295036 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:47.392728 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:47.403532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2aa92c1e-6b54-47a2-808b-364025ec6520 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.200174 Jun 07 13:23:47.404277 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 564/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:47 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:48.427117 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:48.428061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:48.438887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.439685 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.441152 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:48.441955 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:48.626019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:48.640177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8646d175-0df5-4798-bacf-6a6580d0ddfe tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.218518 Jun 07 13:23:48.641214 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 558/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:48 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:49.662990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:49.664079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:49.667240 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:49.677360 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:49.677932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:49.678783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:49.679228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:49.850952 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:49.863580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7dabe7e0-c5b9-47fb-9a03-4a0ef0022656 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.207784 Jun 07 13:23:49.864942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 565/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:49 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:49.999537 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8b66aca2-b6c7-40f6-9345-44b3f2b36907 req-8c23c930-3810-46fb-8331-8b0317c51c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e114e3-a152-4d83-956e-cb6dcd04ce2c", "name": "network-vif-plugged", "status": "completed", "tag": "0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:50.007467 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=38 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:50.015985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8b66aca2-b6c7-40f6-9345-44b3f2b36907 req-8c23c930-3810-46fb-8331-8b0317c51c55 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.016437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8b66aca2-b6c7-40f6-9345-44b3f2b36907 req-8c23c930-3810-46fb-8331-8b0317c51c55 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.032109 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8b66aca2-b6c7-40f6-9345-44b3f2b36907 req-8c23c930-3810-46fb-8331-8b0317c51c55 service nova] Creating event network-vif-plugged:0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d for instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c on hv-cinder-84496 Jun 07 13:23:50.037656 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8b66aca2-b6c7-40f6-9345-44b3f2b36907 req-8c23c930-3810-46fb-8331-8b0317c51c55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045423 Jun 07 13:23:50.038449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 559/1124] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:23:50.886375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:50.887249 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:50.895041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.895494 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:50.896282 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:50.896721 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:51.083611 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:51.095837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-046cbd47-f924-48b2-8a29-9bef6053e32e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.213975 Jun 07 13:23:51.096891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 566/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:50 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:23:52.120676 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:52.121644 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:52.133050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.133706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.135055 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:52.135541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:52.312515 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:52.324865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b0922a0-52c8-4f91-b40b-2a2444052825 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1318 microversion: 2.1 time: 0.211670 Jun 07 13:23:52.326388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 560/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:52 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:53.351574 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:23:53.352266 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:53.358995 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.359548 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.360539 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.361100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.364934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=96 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:23:53.552100 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:23:53.561050 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-54250cf7-30f8-4f49-99ea-d5f216bb08dc tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1506 microversion: 2.1 time: 0.215080 Jun 07 13:23:53.562176 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 567/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:23:53 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:23:53.580208 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8121c64-1792-47f1-a243-594a49e4b854", "device": "/dev/sdb"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:23:53.583130 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:23:53.590104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.590556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.591460 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:23:53.591900 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:23:53.942125 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ed795bc7-a459-445e-8c89-be98cb935c4e tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "POST /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367093 Jun 07 13:23:53.943697 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 561/1128] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:23:53 2022] POST /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:22.087302 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:22.088315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:22.090137 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=9 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:22.090782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=5 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:22.097328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.097867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.098693 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:22.099145 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:22.215052 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lazy-loading 'services' on Instance uuid 12e114e3-a152-4d83-956e-cb6dcd04ce2c {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:22.315615 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9c16f2cb-8630-426c-9668-5c55159f2262 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c/os-volume_attachments/d8121c64-1792-47f1-a243-594a49e4b854" status: 202 len: 0 microversion: 2.1 time: 0.231907 Jun 07 13:24:22.317192 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 568/1129] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:24:22 2022] DELETE /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c/os-volume_attachments/d8121c64-1792-47f1-a243-594a49e4b854 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:24:24.538127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=5 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:24.539810 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:24:24.548203 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:24.550654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:24.566484 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.567468 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.568877 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.569915 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.618120 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:24:24.712812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5a6ba192-1de5-4237-b8cf-1dc7797f9a05 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 204 len: 0 microversion: 2.1 time: 0.177506 Jun 07 13:24:24.713815 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 562/1130] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:24:24 2022] DELETE /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:24:24.724925 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:24.725852 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:24.733486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.733951 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.734750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:24.735190 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:24.911757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:24.921279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-10a61bb0-a137-4e15-a6ed-ef2e3ea1c2c3 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1512 microversion: 2.1 time: 0.201970 Jun 07 13:24:24.921855 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 569/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:24 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:24:25.940577 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:25.941197 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:25.949553 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:25.950048 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:25.950889 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:25.951416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:26.135092 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:26.147168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-716f7270-a1d1-445a-a0c0-4b1d0b669748 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1512 microversion: 2.1 time: 0.210770 Jun 07 13:24:26.152098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 563/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:25 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:27.172797 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:27.173562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:27.182158 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.182814 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.183645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.184085 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.372125 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:27.385328 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-06877cf9-c251-420d-b5c1-0fff0f071285 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1512 microversion: 2.1 time: 0.218840 Jun 07 13:24:27.386419 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 570/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:27 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:27.855274 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-baa41845-9af6-47b8-8491-cbfbd127cce1 req-11b1964f-ad4c-4627-86d2-8e15dcf542fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e114e3-a152-4d83-956e-cb6dcd04ce2c", "name": "network-vif-deleted", "tag": "0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:24:27.865285 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-baa41845-9af6-47b8-8491-cbfbd127cce1 req-11b1964f-ad4c-4627-86d2-8e15dcf542fe service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:27.865777 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-baa41845-9af6-47b8-8491-cbfbd127cce1 req-11b1964f-ad4c-4627-86d2-8e15dcf542fe service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:27.878024 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-baa41845-9af6-47b8-8491-cbfbd127cce1 req-11b1964f-ad4c-4627-86d2-8e15dcf542fe service nova] Creating event network-vif-deleted:0cf6e4e2-091e-4ae9-8b19-d89b1e22bd4d for instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c on hv-cinder-84496 Jun 07 13:24:27.883773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-baa41845-9af6-47b8-8491-cbfbd127cce1 req-11b1964f-ad4c-4627-86d2-8e15dcf542fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Jun 07 13:24:27.884782 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 564/1134] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:24:28.413678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:28.414803 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:28.426243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:28.426970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:28.428261 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:28.429045 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:28.483594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:28.483970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:28.484643 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lazy-loading 'fault' on Instance uuid 12e114e3-a152-4d83-956e-cb6dcd04ce2c {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:24:28.545547 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ccfbda39c494fcfadded542666d3df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbeb18fed89a458e9ba2a998a73fe899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:24:28.557926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f9ada597-2efb-4700-94f5-f3e7c1e43ad8 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 200 len: 1308 microversion: 2.1 time: 0.151109 Jun 07 13:24:28.558896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 571/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:28 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:24:29.584878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:24:29.585983 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] [instance: 12e114e3-a152-4d83-956e-cb6dcd04ce2c] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:24:29.594561 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.595002 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.595857 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:24:29.596233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:24:29.611568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] HTTP exception thrown: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Request method failure captured: Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c HTTP/1.1 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1DxsP-fXgVoZzJod9T8zQNwkefdielBJrtz4EuXRR8kTDnYTEMz7gRpE-EF_ec4yuvn0eV5m5G3H1O0m4BnPLiTL4n1MpjAXHRv13kp3Qeqim_I8EerlKu3ZWCzb5PIXJRwGmAfrdnaT85dH-n48vRpNhZ11y6BLflCRRr4jfdIHac Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: dbeb18fed89a458e9ba2a998a73fe899 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:24:29.613369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dbeb18fed89a458e9ba2a998a73fe899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: dbeb18fed89a458e9ba2a998a73fe899 Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-936303282 Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-VolumesSnapshotTestJSON-936303282-project Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 6ccfbda39c494fcfadded542666d3df3 Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-VolumesSnapshotTestJSON-936303282-project Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. Jun 07 13:24:29.615239 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '12e114e3-a152-4d83-956e-cb6dcd04ce2c'} Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:24:29.616359 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. Jun 07 13:24:29.618579 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:24:29.621206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] Returning 404 to user: Instance 12e114e3-a152-4d83-956e-cb6dcd04ce2c could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:24:29.621206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7ae6b25a-5c4c-40da-9122-5ec741c69bd2 tempest-VolumesSnapshotTestJSON-936303282 tempest-VolumesSnapshotTestJSON-936303282-project] 10.222.0.20 "GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c" status: 404 len: 111 microversion: 2.1 time: 0.038783 Jun 07 13:24:29.621206 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 565/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:24:29 2022] GET /compute/v2.1/servers/12e114e3-a152-4d83-956e-cb6dcd04ce2c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:24.483111 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:24.483746 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:24.487166 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=10 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:24.488244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:24.493644 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-546775cb-f504-4ffe-9979-02c48c974a14 req-1643cbbf-67b2-4925-baae-03d4fba65cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:24.497580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:24.498167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:24.499138 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:24.499816 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:24.507692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:24.508678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:24.515012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-546775cb-f504-4ffe-9979-02c48c974a14 req-1643cbbf-67b2-4925-baae-03d4fba65cdf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:24.515696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-546775cb-f504-4ffe-9979-02c48c974a14 req-1643cbbf-67b2-4925-baae-03d4fba65cdf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:24.532391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:24.541429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-546775cb-f504-4ffe-9979-02c48c974a14 req-1643cbbf-67b2-4925-baae-03d4fba65cdf service nova] Creating event network-changed:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:25:24.547489 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-546775cb-f504-4ffe-9979-02c48c974a14 req-1643cbbf-67b2-4925-baae-03d4fba65cdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064121 Jun 07 13:25:24.548234 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 566/1137] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:24.649153 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-8d071ee7-9411-4f4b-b410-45f4592762d6 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 204 len: 0 microversion: 2.1 time: 0.169837 Jun 07 13:25:24.650335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 572/1138] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:24 2022] DELETE /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:25:24.666145 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:24.666650 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:24.679734 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:24.680754 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:24.681876 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:24.682302 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:24.904457 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:24.918547 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3d9de52b-c8f6-453a-83cc-741253939d11 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.258681 Jun 07 13:25:24.919515 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 567/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:24 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:25.946933 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:25.947724 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:25.954780 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:25.955467 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:25.956349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:25.956792 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:26.128585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:26.137341 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-69c91e48-ded9-46d5-84f3-26a0fa47f9aa tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.195247 Jun 07 13:25:26.149512 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 573/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:25 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:27.169496 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:27.170294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:27.178317 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:27.178779 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:27.179587 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:27.180030 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:27.340291 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:27.350155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-703ff16c-8ded-454c-b3b2-ac15dae79c67 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.186457 Jun 07 13:25:27.351328 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 568/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:27 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:28.377285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:28.378164 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:28.386313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:28.386782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:28.387626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:28.388184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:28.573171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:28.583604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4ecbfe3f-c891-41a3-8c74-8797c0794b2e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.212498 Jun 07 13:25:28.597068 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 574/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:28 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:28.895272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-326c10d2-c535-4cab-99a6-d324a7d74171 req-c7710419-d800-414c-89d0-34364757f664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "name": "network-vif-unplugged", "status": "completed", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:28.911864 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-326c10d2-c535-4cab-99a6-d324a7d74171 req-c7710419-d800-414c-89d0-34364757f664 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:28.913371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-326c10d2-c535-4cab-99a6-d324a7d74171 req-c7710419-d800-414c-89d0-34364757f664 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:28.926520 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-326c10d2-c535-4cab-99a6-d324a7d74171 req-c7710419-d800-414c-89d0-34364757f664 service nova] Creating event network-vif-unplugged:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:25:28.932133 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-326c10d2-c535-4cab-99a6-d324a7d74171 req-c7710419-d800-414c-89d0-34364757f664 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045106 Jun 07 13:25:28.932999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 569/1143] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:25:29.620089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:29.620908 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:29.631941 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:29.632609 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:29.633753 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:29.634368 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:29.821246 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:29.834931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-88ba8962-7d4d-408c-b059-3df594e823ec tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.220582 Jun 07 13:25:29.836787 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 575/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:29 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:30.867454 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:30.868588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:30.881486 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.882270 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:30.883660 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:30.884451 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:31.148427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:31.162943 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-531168fb-b1a2-4966-8a36-4cbb45dc3c3e tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1576 microversion: 2.1 time: 0.301489 Jun 07 13:25:31.163583 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 570/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:30 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1576 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:32.191053 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:32.192021 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:32.202862 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:32.204106 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:32.206410 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:32.207630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:32.535585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:32.553087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-83e03998-f557-45fb-8ed8-751b22739638 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1457 microversion: 2.1 time: 0.366473 Jun 07 13:25:32.553779 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 576/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:32 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1457 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:32.611859 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-8893bd16-2e75-4bb7-a9b3-ee23de7b1a2a req-902840f7-30ee-464d-948e-5b16f7444c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7955312-65c8-4060-966b-e225b25a1a83", "name": "network-vif-deleted", "tag": "3d0a0f61-92bf-4d20-819f-f40a0251d82c"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:32.634942 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8893bd16-2e75-4bb7-a9b3-ee23de7b1a2a req-902840f7-30ee-464d-948e-5b16f7444c14 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:32.635699 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-8893bd16-2e75-4bb7-a9b3-ee23de7b1a2a req-902840f7-30ee-464d-948e-5b16f7444c14 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:32.654081 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-8893bd16-2e75-4bb7-a9b3-ee23de7b1a2a req-902840f7-30ee-464d-948e-5b16f7444c14 service nova] Creating event network-vif-deleted:3d0a0f61-92bf-4d20-819f-f40a0251d82c for instance d7955312-65c8-4060-966b-e225b25a1a83 on hv-cinder-84496 Jun 07 13:25:32.671626 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-8893bd16-2e75-4bb7-a9b3-ee23de7b1a2a req-902840f7-30ee-464d-948e-5b16f7444c14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063643 Jun 07 13:25:32.675012 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 571/1147] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:33.572557 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:33.573800 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:33.599878 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.601163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.602118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.602776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.650912 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:33.652131 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:33.652844 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lazy-loading 'fault' on Instance uuid d7955312-65c8-4060-966b-e225b25a1a83 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:25:33.718006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:33.726224 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-397a6b1c-b536-4ddf-a4bf-56c9792a0a94 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 200 len: 1183 microversion: 2.1 time: 0.158502 Jun 07 13:25:33.727515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 577/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:33 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:34.754296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:34.756839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: d7955312-65c8-4060-966b-e225b25a1a83] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:34.772057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:34.772057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:34.772484 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:34.773063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:34.791752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] HTTP exception thrown: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Request method failure captured: Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 HTTP/1.1 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin0-PzwFrCXcRouic7lNq2oAM6X5m5_D8iECMoVrnGgb3mhcirdZCny7cbjT1J5RbYMc3t2K5nxBOg7LSL53dxp49iTNTL6P0FGyJ99s_jJYekmsOYDGemF_91dprNz-kS8zPbb81LzgA4gUrPe1gQCg94CyZVcgWsOmL3g53CnqeYUY Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:25:34.794060 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03491cee113744268fc89b63330c21c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03491cee113744268fc89b63330c21c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 43f9e7923ebb4939ac2bd590270b48d7 Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. Jun 07 13:25:34.795663 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'd7955312-65c8-4060-966b-e225b25a1a83'} Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:34.796455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. Jun 07 13:25:34.798449 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:34.800046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Returning 404 to user: Instance d7955312-65c8-4060-966b-e225b25a1a83 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:34.800046 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0a1e32db-7dd3-4c80-881c-16a0e2aa719b tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83" status: 404 len: 111 microversion: 2.1 time: 0.049962 Jun 07 13:25:34.800790 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 572/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:34 2022] GET /compute/v2.1/servers/d7955312-65c8-4060-966b-e225b25a1a83 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:38.456962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:38.459655 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:38.481791 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:38.484679 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:38.486575 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:38.487905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:38.489144 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-1c5b8e29-0999-418d-846a-50c4a680c4b1 req-d891da7b-6c23-4c02-bf06-5ffa7dada95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c76284-90fa-4dc0-a1a9-bc3285a60efe", "tag": "22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:38.534636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1c5b8e29-0999-418d-846a-50c4a680c4b1 req-d891da7b-6c23-4c02-bf06-5ffa7dada95b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:38.535884 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-1c5b8e29-0999-418d-846a-50c4a680c4b1 req-d891da7b-6c23-4c02-bf06-5ffa7dada95b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:38.553693 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-1c5b8e29-0999-418d-846a-50c4a680c4b1 req-d891da7b-6c23-4c02-bf06-5ffa7dada95b service nova] Creating event network-changed:22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd for instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe on hv-cinder-84496 Jun 07 13:25:38.565241 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-1c5b8e29-0999-418d-846a-50c4a680c4b1 req-d891da7b-6c23-4c02-bf06-5ffa7dada95b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078623 Jun 07 13:25:38.568131 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 573/1150] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:38.590895 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Going to try to terminate instance {{(pid=117833) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:25:38.827387 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a15925c4-f2fb-400c-8fa8-67e563b5dbdd tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "DELETE /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 204 len: 0 microversion: 2.1 time: 0.372741 Jun 07 13:25:38.830608 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 578/1151] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:38 2022] DELETE /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:25:38.843050 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:38.844337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:38.858014 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:38.868922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:38.870310 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:38.872737 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:39.208191 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:39.229452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d1f80f0e-3ce4-4831-aaea-e20e48075631 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1576 microversion: 2.1 time: 0.392775 Jun 07 13:25:39.230256 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 574/1152] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:38 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1576 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:40.272668 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:40.295272 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:40.340946 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:40.344181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:40.353234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:40.354029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:40.819595 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-d082fd65-79d1-47c1-b0ef-112a97599efc req-2aafaf36-6e9c-4055-8fe9-e8d57db635ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c76284-90fa-4dc0-a1a9-bc3285a60efe", "name": "network-vif-deleted", "tag": "22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:40.832500 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d082fd65-79d1-47c1-b0ef-112a97599efc req-2aafaf36-6e9c-4055-8fe9-e8d57db635ab service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:40.832953 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-d082fd65-79d1-47c1-b0ef-112a97599efc req-2aafaf36-6e9c-4055-8fe9-e8d57db635ab service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:40.855251 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-d082fd65-79d1-47c1-b0ef-112a97599efc req-2aafaf36-6e9c-4055-8fe9-e8d57db635ab service nova] Creating event network-vif-deleted:22b88f70-e67d-4fa4-a568-c3e6c1f8d8bd for instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe on hv-cinder-84496 Jun 07 13:25:40.867966 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-d082fd65-79d1-47c1-b0ef-112a97599efc req-2aafaf36-6e9c-4055-8fe9-e8d57db635ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055598 Jun 07 13:25:40.875355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 575/1153] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:25:40.920669 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f9e7923ebb4939ac2bd590270b48d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03491cee113744268fc89b63330c21c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:40.950999 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bff2c0dd-e7b2-4113-b950-002d22c74a73 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 200 len: 1576 microversion: 2.1 time: 0.697521 Jun 07 13:25:40.956354 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 579/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:40 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 1576 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:25:41.982476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:41.983324 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: 97c76284-90fa-4dc0-a1a9-bc3285a60efe] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:42.012414 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:42.022567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:42.032596 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:42.034384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:42.072289 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] HTTP exception thrown: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Request method failure captured: Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe HTTP/1.1 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin0-PzwFrCXcRouic7lNq2oAM6X5m5_D8iECMoVrnGgb3mhcirdZCny7cbjT1J5RbYMc3t2K5nxBOg7LSL53dxp49iTNTL6P0FGyJ99s_jJYekmsOYDGemF_91dprNz-kS8zPbb81LzgA4gUrPe1gQCg94CyZVcgWsOmL3g53CnqeYUY Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:25:42.077259 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03491cee113744268fc89b63330c21c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03491cee113744268fc89b63330c21c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 43f9e7923ebb4939ac2bd590270b48d7 Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. Jun 07 13:25:42.080213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '97c76284-90fa-4dc0-a1a9-bc3285a60efe'} Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:42.082786 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. Jun 07 13:25:42.085602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.089878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Returning 404 to user: Instance 97c76284-90fa-4dc0-a1a9-bc3285a60efe could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:42.089878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3033b309-1031-4ea1-8097-082ca78b531d tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe" status: 404 len: 111 microversion: 2.1 time: 0.114589 Jun 07 13:25:42.089878 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 576/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:41 2022] GET /compute/v2.1/servers/97c76284-90fa-4dc0-a1a9-bc3285a60efe => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:42.931196 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:42.931778 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:42.939774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:42.940616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:42.941774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:42.942871 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:42.965540 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] HTTP exception thrown: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Request method failure captured: Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 HTTP/1.1 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin0-PzwFrCXcRouic7lNq2oAM6X5m5_D8iECMoVrnGgb3mhcirdZCny7cbjT1J5RbYMc3t2K5nxBOg7LSL53dxp49iTNTL6P0FGyJ99s_jJYekmsOYDGemF_91dprNz-kS8zPbb81LzgA4gUrPe1gQCg94CyZVcgWsOmL3g53CnqeYUY Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:25:42.969007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03491cee113744268fc89b63330c21c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03491cee113744268fc89b63330c21c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 43f9e7923ebb4939ac2bd590270b48d7 Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:42.972051 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'a6f08c6a-dd16-4928-a462-8c396f9608a6'} Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:42.973846 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:42.978064 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:25:42.983944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Returning 404 to user: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:42.985586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-bd0f2f0f-1b1c-40fb-84f2-7bdd5d373d53 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 404 len: 111 microversion: 2.1 time: 0.058179 Jun 07 13:25:42.987206 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 580/1156] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:25:42 2022] DELETE /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:25:42.996665 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:42.998326 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] [instance: a6f08c6a-dd16-4928-a462-8c396f9608a6] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:43.023031 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:43.023641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:43.024648 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:43.025630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:43.046556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] HTTP exception thrown: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Request method failure captured: Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 HTTP/1.1 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin0-PzwFrCXcRouic7lNq2oAM6X5m5_D8iECMoVrnGgb3mhcirdZCny7cbjT1J5RbYMc3t2K5nxBOg7LSL53dxp49iTNTL6P0FGyJ99s_jJYekmsOYDGemF_91dprNz-kS8zPbb81LzgA4gUrPe1gQCg94CyZVcgWsOmL3g53CnqeYUY Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:25:43.048688 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/03491cee113744268fc89b63330c21c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/03491cee113744268fc89b63330c21c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_03491cee113744268fc89b63330c21c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 03491cee113744268fc89b63330c21c2 Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-TestVolumeBootPattern-2052138076 Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: 43f9e7923ebb4939ac2bd590270b48d7 Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-TestVolumeBootPattern-2052138076-project Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:43.050345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'a6f08c6a-dd16-4928-a462-8c396f9608a6'} Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:25:43.051279 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. Jun 07 13:25:43.052935 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:25:43.055911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Returning 404 to user: Instance a6f08c6a-dd16-4928-a462-8c396f9608a6 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:25:43.056801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5d0b5cfe-5689-40d2-adee-c473c3a5b930 tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6" status: 404 len: 111 microversion: 2.1 time: 0.065210 Jun 07 13:25:43.061616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 577/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:42 2022] GET /compute/v2.1/servers/a6f08c6a-dd16-4928-a462-8c396f9608a6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:25:44.694361 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b6b1a784-c431-4d53-a0a4-f33e393a080f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] Calling method '.version_select at 0x7f20a47fb1f0>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:44.736414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b6b1a784-c431-4d53-a0a4-f33e393a080f tempest-TestVolumeBootPattern-2052138076 tempest-TestVolumeBootPattern-2052138076-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-624960488" status: 202 len: 0 microversion: 2.1 time: 0.054942 Jun 07 13:25:44.741133 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 581/1158] 10.222.0.20 () {58 vars in 1259 bytes} [Tue Jun 7 13:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-624960488 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:25:58.437858 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-79aba486-34c2-4077-9960-d1122bf5cb52 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'create', calling method: .version_select at 0x7f20a47cb280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-397922641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOSgGb2nh1QFMS6x5wgk4QUX139OECicio3pz2g51POeP33v53tE37K99uTQNjp+b35WJkoY2/lW55eizqm06Pi0T420tPT9R/bUi5w6MZ6YKHPEvOdKHLfF1hLoivlyg=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:58.444217 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=24 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.445429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=40 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.460832 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-79aba486-34c2-4077-9960-d1122bf5cb52 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Getting quotas for project e94ac089c7dd468b8f0ca7f8fa14769e. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:25:58.470647 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-79aba486-34c2-4077-9960-d1122bf5cb52 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Getting quotas for user 0ff2575eecdc4e668844f62411861db9 and project e94ac089c7dd468b8f0ca7f8fa14769e. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:25:58.523452 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-79aba486-34c2-4077-9960-d1122bf5cb52 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.090210 Jun 07 13:25:58.524063 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 578/1159] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:25:58.659603 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.661644 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:25:58.668093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1779190350", "imageRef": "1ab61fed-77dc-4629-82b0-2df9b7afee11", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-397922641", "networks": [{"uuid": "12475818-b132-418b-bc3f-b7a39ce0c762"}]}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:25:58.753890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] validate_networks() for [('12475818-b132-418b-bc3f-b7a39ce0c762', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:25:59.212672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:25:59.213122 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:25:59.213594 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:25:59.214007 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:25:59.214414 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:25:59.224916 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:59.225389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:59.226276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:25:59.226756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:25:59.247234 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Getting quotas for project e94ac089c7dd468b8f0ca7f8fa14769e. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:25:59.255430 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Getting quotas for user 0ff2575eecdc4e668844f62411861db9 and project e94ac089c7dd468b8f0ca7f8fa14769e. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:25:59.272889 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:25:59.275231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ab61fed-77dc-4629-82b0-2df9b7afee11',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:25:59.328146 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-9603517a-8365-4e68-8046-c368436927b8 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676282 Jun 07 13:25:59.328849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 582/1160] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:25:59.342403 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-68c9a220-2f14-4ffe-8780-bd5d76ae8ef0 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:25:59.343042 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-68c9a220-2f14-4ffe-8780-bd5d76ae8ef0 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:25:59.406398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-68c9a220-2f14-4ffe-8780-bd5d76ae8ef0 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:25:59.414911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-68c9a220-2f14-4ffe-8780-bd5d76ae8ef0 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1258 microversion: 2.1 time: 0.078558 Jun 07 13:25:59.415494 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 579/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:25:59 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:00.438867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:00.439602 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:00.446901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:00.447347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:00.448128 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:00.448554 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:00.518257 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:00.527953 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-62995963-6892-482d-ae8e-1e6d92116972 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1318 microversion: 2.1 time: 0.093473 Jun 07 13:26:00.529239 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 583/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:00 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:01.553839 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:01.554796 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:01.570690 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:01.571552 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:01.572741 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:01.573465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:01.804516 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:01.821614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d95f4220-2040-479a-82b3-94efa82a702c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.272701 Jun 07 13:26:01.823565 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 580/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:01 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:02.469295 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:02.470029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:02.477182 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.477637 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:02.478483 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.478921 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:02.512072 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-f65e7718-1cfd-4b7d-ada7-c6e97b2a8633 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/ips" status: 200 len: 151 microversion: 2.1 time: 0.421359 Jun 07 13:26:02.514167 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 584/1164] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:26:02 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/ips => generated 151 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:02.847771 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:02.848645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:02.866186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.866653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:02.867465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:02.867924 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:03.125813 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:03.134615 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-269a130a-7325-41dd-9fb2-0bb017717de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.291437 Jun 07 13:26:03.135123 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 581/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:02 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:04.106849 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19767865-31af-44a2-92e2-2df658c39477"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:04.108207 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:04.115723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.116174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.116952 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.117446 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.153066 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:04.153686 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:04.162993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.163718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.164946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:04.165428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:04.345849 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:04.354610 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3589b855-7951-4b32-8b14-e5de8429e096 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.205832 Jun 07 13:26:04.355658 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 582/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:04 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:05.375159 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:05.376731 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:05.383773 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.384588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.385759 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:05.386413 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:05.604155 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:05.614034 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-aaf43880-98a2-4662-9c64-5a6b7b4b6749 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.243532 Jun 07 13:26:05.614614 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 583/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:05 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:06.632567 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:06.633837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:06.642219 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.642985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.644384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:06.645139 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:06.806921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:06.816385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-417b6437-8b56-4c1f-9acd-6f3555bdca43 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.187634 Jun 07 13:26:06.817275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 584/1168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:06 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:07.844513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:07.845746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:07.858315 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.859202 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:07.860622 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:07.861084 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:08.052729 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:08.070842 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-cc9391cb-f35d-4ecf-a589-b7c57af1555c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.233924 Jun 07 13:26:08.072233 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 585/1169] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:07 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:09.091177 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:09.091921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:09.100104 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:09.100761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:09.101736 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:09.102385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:09.233559 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:09.267082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=6 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:09.308384 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:09.323603 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1fcf25e1-9ea2-42e6-9098-7f79bfe566e5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.236049 Jun 07 13:26:09.324755 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 586/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:09 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:10.350852 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:10.352257 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:10.353957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=6 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:10.363582 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.364385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.368275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:10.369085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:10.556183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:10.564938 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c30231a3-282b-4460-978a-9b3f55d4b9a9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.217976 Jun 07 13:26:10.565586 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 587/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:10 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:11.586399 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:11.587439 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:11.598718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.599575 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.601134 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:11.601930 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:11.777505 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:11.785749 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-0865ddf3-f9ee-4217-9ffc-104450f39a4c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.206776 Jun 07 13:26:11.786348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 588/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:11 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:12.805246 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:12.806550 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:12.814389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.814838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:12.815646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:12.816077 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:13.004416 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:13.012745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-109394fe-d8e7-40b0-9772-4e2546663109 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.212098 Jun 07 13:26:13.013378 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 589/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:12 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:13.959790 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e871720a-d9b5-4672-bda7-6b1cbebd16f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.856786 Jun 07 13:26:13.960950 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 585/1174] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:26:04 2022] POST /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments => generated 194 bytes in 9859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:14.042028 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:14.044566 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:14.056761 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:14.057459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:14.058404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:14.059298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:14.309905 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:14.318711 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6c2188b7-5dd0-4a1f-9d84-1024a9a7ca7a tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.284433 Jun 07 13:26:14.319572 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 590/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:14 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:14.724488 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-558d978e-3a0f-4129-a141-48637ed7ec30 req-97c33cca-f673-4186-9559-d958f503e7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:14.734564 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:14.743940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-558d978e-3a0f-4129-a141-48637ed7ec30 req-97c33cca-f673-4186-9559-d958f503e7a7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:14.744655 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-558d978e-3a0f-4129-a141-48637ed7ec30 req-97c33cca-f673-4186-9559-d958f503e7a7 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:14.770442 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-558d978e-3a0f-4129-a141-48637ed7ec30 req-97c33cca-f673-4186-9559-d958f503e7a7 service nova] Creating event network-changed:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:26:14.779899 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-558d978e-3a0f-4129-a141-48637ed7ec30 req-97c33cca-f673-4186-9559-d958f503e7a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061351 Jun 07 13:26:14.781759 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 586/1176] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:15.338201 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:15.338820 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:15.346198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.346642 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.347428 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:15.347865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:15.508461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:15.519678 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3fa327bb-2a6e-4845-947c-d110651ad33b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.185379 Jun 07 13:26:15.520654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 591/1177] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:15 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:16.556028 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:16.556926 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:16.564990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.565449 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.566219 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:16.566646 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:16.756165 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:16.769227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1c6245c5-788c-4fb3-838b-39a79a51cbe4 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.217765 Jun 07 13:26:16.769841 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 587/1178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:16 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:17.794462 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:17.795162 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:17.803194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.803646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:17.804424 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:17.804863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:18.050427 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:18.058322 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7c06604f-9657-44d6-a59c-dfc7a0f78057 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.269706 Jun 07 13:26:18.058904 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 592/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:17 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:19.077435 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:19.078308 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:19.085413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.085863 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.086641 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:19.087080 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:19.254806 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:19.262772 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-53fb1b7a-6d3d-4cf9-a6d7-4bb86e0479e1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.190553 Jun 07 13:26:19.263358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 588/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:19 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:20.280267 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:20.280856 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:20.288213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.288668 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.289541 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:20.289980 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:20.450568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:20.465797 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-7650f7ec-5c1e-4508-aa43-2f7f2e84f6c5 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.189598 Jun 07 13:26:20.466982 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 593/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:20 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:21.074972 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-d9ac4918-4990-4e8a-b273-394e7033084a req-c21cf628-a6d7-45f1-b464-5f74af3f3c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "name": "network-vif-plugged", "status": "completed", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:21.088890 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d9ac4918-4990-4e8a-b273-394e7033084a req-c21cf628-a6d7-45f1-b464-5f74af3f3c3b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.089723 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-d9ac4918-4990-4e8a-b273-394e7033084a req-c21cf628-a6d7-45f1-b464-5f74af3f3c3b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.104877 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-d9ac4918-4990-4e8a-b273-394e7033084a req-c21cf628-a6d7-45f1-b464-5f74af3f3c3b service nova] Creating event network-vif-plugged:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:26:21.111272 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-d9ac4918-4990-4e8a-b273-394e7033084a req-c21cf628-a6d7-45f1-b464-5f74af3f3c3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042408 Jun 07 13:26:21.112500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 589/1182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:21.485397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:21.486168 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.497090 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.498174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.499762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.500192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.650742 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19767865-31af-44a2-92e2-2df658c39477"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:21.652820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.660894 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.661620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.662429 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.662872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.683991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:21.696801 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-eadfd087-9504-44b5-adfa-bc1b181a5aac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.216607 Jun 07 13:26:21.697616 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 594/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:21 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:21.766248 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: POST /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments HTTP/1.1 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 74 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:26:21.768024 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {"volumeAttachment": {"volumeId": "19767865-31af-44a2-92e2-2df658c39477"}} Jun 07 13:26:21.770640 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '12378db2-7d47-48c5-bec0-3ca2b6ea9b15', 'body': {'volumeAttachment': {'volumeId': '19767865-31af-44a2-92e2-2df658c39477'}}} Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:26:21.771712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:21.773228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 400 to user: Invalid volume: volume 19767865-31af-44a2-92e2-2df658c39477 is already attached to instances: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-de722e5e-46a7-4364-91b2-ab5817380bcc tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128204 Jun 07 13:26:21.775391 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 590/1184] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:26:21 2022] POST /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 07 13:26:21.846887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:21.847393 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:21.854296 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.854745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.855543 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:21.855978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:21.957967 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.objects.instance [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lazy-loading 'services' on Instance uuid 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 {{(pid=117832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:26:22.031807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:22.045803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b17b1735-3170-447b-8289-0c76626d80e2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments/19767865-31af-44a2-92e2-2df658c39477" status: 202 len: 0 microversion: 2.1 time: 0.202773 Jun 07 13:26:22.046398 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 595/1185] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:26:21 2022] DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments/19767865-31af-44a2-92e2-2df658c39477 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:22.055485 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:22.056529 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:22.063716 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.064250 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.065367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.065902 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.098244 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e87cb3bd-8508-47aa-bb55-1cbbd2b75701 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 Jun 07 13:26:22.099273 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 591/1186] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:26:22 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:22.723725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:22.724429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:22.731127 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.731572 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.732431 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:22.732862 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:22.879868 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:22.892911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-dd22813e-5f74-400d-9c96-1ec543edb661 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1358 microversion: 2.1 time: 0.173844 Jun 07 13:26:22.893962 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 596/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:22 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:23.110513 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.111457 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.123109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.123461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.124255 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.124692 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.153974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-c3f38909-f259-4db0-8631-6e7f7e6d4578 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Jun 07 13:26:23.154545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 592/1188] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:23.914447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:23.915355 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:23.925827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.926282 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:23.927061 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:23.927502 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.078321 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.086569 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99a0b844-47ea-40d0-9a18-da4e248c8630 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1547 microversion: 2.1 time: 0.178776 Jun 07 13:26:24.087153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 597/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:23 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.103351 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.103960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.110944 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.112231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.112496 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.112937 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.167095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.168154 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.175275 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.175720 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.176495 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.176920 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.209887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9effe7f7-e0ee-4986-8e09-18eb3a650730 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046489 Jun 07 13:26:24.210479 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 598/1190] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 13:26:24.276660 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.283711 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.283907 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-fadd6158-1bf8-48ba-b470-24dc15325122 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1547 microversion: 2.1 time: 0.184224 Jun 07 13:26:24.284746 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.284947 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 593/1191] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.291174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.291617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.292395 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.292829 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.300896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.304272 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.304917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Searching by: {'deleted': False, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e'} {{(pid=117833) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 13:26:24.312187 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.312682 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.313671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.313990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.322198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:26:24.415684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-d3acbba0-1be3-4d0f-b651-a3888622e4be tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 204 len: 0 microversion: 2.1 time: 0.135425 Jun 07 13:26:24.416939 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 599/1192] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:26:24 2022] DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:26:24.419358 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.multi_cell_list [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117833) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 13:26:24.439397 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.440778 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.450481 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.451182 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.452343 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.452987 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.539395 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7992482b-a051-42f3-aa8a-2808501ce4df tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.242150 Jun 07 13:26:24.540181 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 594/1193] 10.222.0.20 () {58 vars in 1124 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:24.550954 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:24.551592 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:24.557935 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.558373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.559139 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:24.559550 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:24.600738 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.612816 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3b120c36-25b6-4159-b2bb-8479da04e785 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1682 microversion: 2.1 time: 0.180250 Jun 07 13:26:24.613823 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 600/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:24.732671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:24.745093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e997751f-68bb-4424-aa17-252db2a9585e tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1547 microversion: 2.1 time: 0.198310 Jun 07 13:26:24.745676 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 595/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:24 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:25.635007 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:25.635806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:25.643183 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.643636 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.644429 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:25.644865 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:25.804933 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:25.813863 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ac7fe24a-9780-40ff-bc29-b68bb2f4513f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1682 microversion: 2.1 time: 0.183048 Jun 07 13:26:25.814618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 601/1196] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:25 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:26.345332 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "719578cd-db53-4c97-9694-5ad48f8c6b35"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:26.346313 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.353490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.353943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.354720 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.355276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.683589 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-08cf5908-8233-4c23-9250-68bf5b363e49 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342408 Jun 07 13:26:26.684213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 596/1197] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:26:26 2022] POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:26.832640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:26.833620 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:26.846712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.846712 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:26.847812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:26.848174 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.132809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:27.149701 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-acb0d5e5-e1d8-4625-b878-843266f30f59 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 200 len: 1682 microversion: 2.1 time: 0.320592 Jun 07 13:26:27.151781 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 602/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:26 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 1682 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:27.461276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-fdaebd14-c074-4d28-83c8-5ba80624d7f8 req-1d5052f3-df99-44ee-ab6d-1f251e19a5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12378db2-7d47-48c5-bec0-3ca2b6ea9b15", "name": "network-vif-deleted", "tag": "bcc5093c-262c-4411-ac1b-8e1c899a4271"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:27.485126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fdaebd14-c074-4d28-83c8-5ba80624d7f8 req-1d5052f3-df99-44ee-ab6d-1f251e19a5bf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:27.485562 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-fdaebd14-c074-4d28-83c8-5ba80624d7f8 req-1d5052f3-df99-44ee-ab6d-1f251e19a5bf service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:27.514141 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-fdaebd14-c074-4d28-83c8-5ba80624d7f8 req-1d5052f3-df99-44ee-ab6d-1f251e19a5bf service nova] Creating event network-vif-deleted:bcc5093c-262c-4411-ac1b-8e1c899a4271 for instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 on hv-cinder-84496 Jun 07 13:26:27.523943 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-fdaebd14-c074-4d28-83c8-5ba80624d7f8 req-1d5052f3-df99-44ee-ab6d-1f251e19a5bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067486 Jun 07 13:26:27.525648 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 597/1199] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:28.169824 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.170508 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:28.181946 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.182392 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.183169 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:28.183627 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:28.201308 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 HTTP/1.1 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:26:28.202848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:26:28.204510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '12378db2-7d47-48c5-bec0-3ca2b6ea9b15'} Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:26:28.205530 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:26:28.207276 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:26:28.209706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:26:28.209706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c0f3cea2-51ea-42df-8319-a0cd44968d8f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 404 len: 111 microversion: 2.1 time: 0.038699 Jun 07 13:26:28.209706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 603/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:28 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:26:28.220905 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-50dbe8f8-fc8b-408e-b2a2-1eeda922adf1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '.version_select at 0x7f20a471b040>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:28.241006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-50dbe8f8-fc8b-408e-b2a2-1eeda922adf1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165938237" status: 202 len: 0 microversion: 2.1 time: 0.027706 Jun 07 13:26:28.241988 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 598/1201] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jun 7 13:26:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165938237 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:28.970986 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c2f9c752-0575-441d-a9ae-cb9ca6761fbd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: .version_select at 0x7f20a4a9b160>, body: {"keypair": {"name": "tempest-keypair-358748480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1g5ATie64BeHPm1UHV3hmv8/QSworQncOVZ5t+kbmEPeUXWXYBSrKXr6tS2kEBGkScCV1sRPh5xXPCnodEfjOocNBA2zCnhCIKs8n9853M+rjaOm/0r7m3AwvwrWslew=="}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:28.978192 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:28.994783 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c2f9c752-0575-441d-a9ae-cb9ca6761fbd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:28.999511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.quota [None req-c2f9c752-0575-441d-a9ae-cb9ca6761fbd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'key_pairs'} {{(pid=117832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:29.024511 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c2f9c752-0575-441d-a9ae-cb9ca6761fbd tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060084 Jun 07 13:26:29.025153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 604/1202] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jun 7 13:26:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:30.439733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-173057757", "imageRef": "f9cfec57-655f-4652-b55b-8a1fecd2c478", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4c5b29e-534b-4458-943d-262c9e18bfb9"}], "security_groups": [{"name": "tempest-securitygroup--2096262471"}], "key_name": "tempest-keypair-358748480", "user_data": "}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:30.562365 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.network.neutron [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] validate_networks() for [('a4c5b29e-534b-4458-943d-262c9e18bfb9', None, None, None, None, None)] {{(pid=117833) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 13:26:30.993162 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 13:26:30.993590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image limits 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 13:26:30.994089 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Flavor pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 13:26:30.994495 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Image pref 0:0:0 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 13:26:30.994901 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.virt.hardware [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117833) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 13:26:31.004237 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.004678 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.005502 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:31.005932 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:31.012055 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:31.027456 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 13:26:31.032620 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.quota [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Getting quotas for user bf1524fd1042430e97bb60caafef26f3 and project 0fa6e76580734bf5980477d32c87bfc1. Resources: {'ram', 'cores', 'instances'} {{(pid=117833) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 13:26:31.044614 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Going to run 1 instances... {{(pid=117833) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 13:26:31.047260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f9cfec57-655f-4652-b55b-8a1fecd2c478',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117833) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 13:26:31.102108 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a000065b-e5b8-4387-89ba-5404dff21131 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.667258 Jun 07 13:26:31.102744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 599/1203] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jun 7 13:26:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 13:26:31.114506 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6054633c-4f5d-4927-a6f0-4879af3a11d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:31.115128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6054633c-4f5d-4927-a6f0-4879af3a11d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:31.173768 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-6054633c-4f5d-4927-a6f0-4879af3a11d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:31.185756 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6054633c-4f5d-4927-a6f0-4879af3a11d4 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1240 microversion: 2.1 time: 0.076698 Jun 07 13:26:31.186331 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 605/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:31 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:32.204820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e1b3f023-0271-4856-8eb9-4fbffed2aced tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:32.205685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e1b3f023-0271-4856-8eb9-4fbffed2aced tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:32.275712 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-e1b3f023-0271-4856-8eb9-4fbffed2aced tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:32.285478 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e1b3f023-0271-4856-8eb9-4fbffed2aced tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1240 microversion: 2.1 time: 0.084954 Jun 07 13:26:32.286942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 600/1205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:32 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:33.304268 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-4a35d60b-c04d-48d1-a781-e23b3bc2eb3e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:33.306078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-4a35d60b-c04d-48d1-a781-e23b3bc2eb3e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:33.366747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-4a35d60b-c04d-48d1-a781-e23b3bc2eb3e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:33.374574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-4a35d60b-c04d-48d1-a781-e23b3bc2eb3e tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1240 microversion: 2.1 time: 0.074519 Jun 07 13:26:33.375334 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 606/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:33 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:34.305822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:34.306515 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:34.314373 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.314812 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.315588 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:34.316020 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:34.392921 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-9db6c053-80e5-41d0-898f-96a9d0483512 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:34.393802 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-9db6c053-80e5-41d0-898f-96a9d0483512 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:34.457623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-9db6c053-80e5-41d0-898f-96a9d0483512 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:34.466513 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-9db6c053-80e5-41d0-898f-96a9d0483512 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1240 microversion: 2.1 time: 0.078276 Jun 07 13:26:34.467099 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 607/1207] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:34 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:34.523389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:34.545577 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-af8c2802-ac52-4f2d-a660-14906d58b97b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1593 microversion: 2.1 time: 0.243713 Jun 07 13:26:34.546179 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 601/1208] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:34 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1593 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:26:35.484952 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:35.485664 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:35.493348 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.493821 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.494882 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:35.495163 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:35.602956 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:35.615670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e025c0c4-98a7-4985-be34-a363b372e8c8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1244 microversion: 2.1 time: 0.135392 Jun 07 13:26:35.616443 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 608/1209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:35 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1244 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:36.633918 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:36.634776 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:36.643037 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.643486 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.644287 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:36.644718 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:36.726622 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:36.737556 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7c0d75ba-5152-4f95-bda3-f3da5c2cb32f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1298 microversion: 2.1 time: 0.107441 Jun 07 13:26:36.738390 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 602/1210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:36 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:37.243914 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-623b5e7e-9a19-4619-949a-5a0bcfdc3a73 req-19ce86c6-ea8e-485c-b8e5-3a89068c65c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:37.258280 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-623b5e7e-9a19-4619-949a-5a0bcfdc3a73 req-19ce86c6-ea8e-485c-b8e5-3a89068c65c8 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.259404 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-623b5e7e-9a19-4619-949a-5a0bcfdc3a73 req-19ce86c6-ea8e-485c-b8e5-3a89068c65c8 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.277879 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-623b5e7e-9a19-4619-949a-5a0bcfdc3a73 req-19ce86c6-ea8e-485c-b8e5-3a89068c65c8 service nova] Creating event network-changed:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:26:37.287613 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-623b5e7e-9a19-4619-949a-5a0bcfdc3a73 req-19ce86c6-ea8e-485c-b8e5-3a89068c65c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050452 Jun 07 13:26:37.288509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 609/1211] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:37.758465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:37.759260 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:37.788558 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.790566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:37.792245 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:37.793163 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:38.250822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:38.264218 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-246a620b-84fd-4bdf-a170-dd88ff498b25 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.511431 Jun 07 13:26:38.264923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 603/1212] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:37 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:39.199679 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1448622346"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:39.200252 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:39.207483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.207483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.208181 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.208630 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.289634 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:39.290768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:39.298348 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.298796 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.299585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.300022 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.452238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.network.security_group_api [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Adding security group 05d004de-1d12-4d9c-b3db-0dc25cbd4ee4 to port 4162d2f8-1af5-4f68-b874-9646131effc2 Jun 07 13:26:39.452465 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:39.465404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6aba6a6d-4fdf-4da9-87dc-9cb31960b309 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.180146 Jun 07 13:26:39.466298 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 604/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:39 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:39.475276 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-796667ef-93a4-4598-8c58-1e6ee76050cc req-e36575ca-7b90-4d93-83d5-082ab787209c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff24477-c683-43f2-bf86-bc7cd967ae01", "tag": "cf919e4b-1897-44e2-8833-497d33d97868"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:39.489981 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-796667ef-93a4-4598-8c58-1e6ee76050cc req-e36575ca-7b90-4d93-83d5-082ab787209c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:39.490799 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-796667ef-93a4-4598-8c58-1e6ee76050cc req-e36575ca-7b90-4d93-83d5-082ab787209c service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:39.510380 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-796667ef-93a4-4598-8c58-1e6ee76050cc req-e36575ca-7b90-4d93-83d5-082ab787209c service nova] Creating event network-changed:cf919e4b-1897-44e2-8833-497d33d97868 for instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 on hv-cinder-84496 Jun 07 13:26:39.517690 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-796667ef-93a4-4598-8c58-1e6ee76050cc req-e36575ca-7b90-4d93-83d5-082ab787209c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049356 Jun 07 13:26:39.518749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 605/1214] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:40.010509 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-164d218d-08dd-4dd8-93c7-95249dd9c1cb tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action" status: 202 len: 0 microversion: 2.1 time: 0.815547 Jun 07 13:26:40.015969 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 610/1215] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:26:39 2022] POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:26:40.025583 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:40.028065 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:40.042837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.043885 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.045101 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.046079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.252132 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:40.266935 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-00a0a45b-2974-4799-aa6b-13d37a1d4d71 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1758 microversion: 2.1 time: 0.246737 Jun 07 13:26:40.268279 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 606/1216] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:40 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1758 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:40.490910 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:40.491529 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:40.497961 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.498412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.499207 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:40.499677 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:40.677478 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:40.690523 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f35186dc-5d95-41a6-8d8a-ee70d2d292f2 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.204372 Jun 07 13:26:40.691752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 611/1217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:40 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:41.550426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-7802f00a-5bc8-4626-b90d-189b77b164ac req-efa10438-d0ee-4416-a6d7-4814289f7873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:41.554808 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=4 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:41.561347 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7802f00a-5bc8-4626-b90d-189b77b164ac req-efa10438-d0ee-4416-a6d7-4814289f7873 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:41.561782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-7802f00a-5bc8-4626-b90d-189b77b164ac req-efa10438-d0ee-4416-a6d7-4814289f7873 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:41.576222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-7802f00a-5bc8-4626-b90d-189b77b164ac req-efa10438-d0ee-4416-a6d7-4814289f7873 service nova] Creating event network-changed:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:26:41.581867 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-7802f00a-5bc8-4626-b90d-189b77b164ac req-efa10438-d0ee-4416-a6d7-4814289f7873 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Jun 07 13:26:41.582482 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 607/1218] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:41.714019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:41.715860 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:41.728033 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:41.729459 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:41.731085 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:41.733098 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:42.014062 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:42.029310 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-3a7482f4-7e7c-4c28-bd55-01c732bcf053 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.320704 Jun 07 13:26:42.030692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 612/1219] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:41 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:43.051057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell0:SELECT=8 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:43.056334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:43.057110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:43.065545 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:43.066046 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:43.066934 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:43.067383 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:43.219546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:43.231380 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-25fd7be2-c2b0-4761-9062-f5b506a747fe tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.181350 Jun 07 13:26:43.231984 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 608/1220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:43 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:44.254837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:44.256803 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:44.262213 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:44.262662 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:44.263455 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:44.263887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:44.414198 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:44.424612 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e2fc3345-4ab3-41dd-bbf9-46074dd1ca90 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.174153 Jun 07 13:26:44.425250 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 613/1221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:44 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:45.207356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-2888532d-5029-41e7-8e4f-7f4090b9885c req-994d8fd7-8ba1-4d39-b261-f8d10ef62fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff24477-c683-43f2-bf86-bc7cd967ae01", "name": "network-vif-plugged", "status": "completed", "tag": "cf919e4b-1897-44e2-8833-497d33d97868"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:45.220945 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2888532d-5029-41e7-8e4f-7f4090b9885c req-994d8fd7-8ba1-4d39-b261-f8d10ef62fb1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:45.221404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-2888532d-5029-41e7-8e4f-7f4090b9885c req-994d8fd7-8ba1-4d39-b261-f8d10ef62fb1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:45.234035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-2888532d-5029-41e7-8e4f-7f4090b9885c req-994d8fd7-8ba1-4d39-b261-f8d10ef62fb1 service nova] Creating event network-vif-plugged:cf919e4b-1897-44e2-8833-497d33d97868 for instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 on hv-cinder-84496 Jun 07 13:26:45.240367 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-2888532d-5029-41e7-8e4f-7f4090b9885c req-994d8fd7-8ba1-4d39-b261-f8d10ef62fb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039597 Jun 07 13:26:45.241624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 609/1222] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:26:45.443122 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:45.443985 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:45.445945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell0:SELECT=10 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:45.452153 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:45.452608 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:45.453514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:45.453947 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:45.628351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:45.636628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-2b02ffee-53cc-4766-82b4-b3f0ba3aa7f7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.197546 Jun 07 13:26:45.637312 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 614/1223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:45 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:46.655470 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:46.656202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:46.658314 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:26:46.664303 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:46.664745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:46.665546 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:46.665970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:46.846774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:46.855262 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b923fdff-6f1b-4e5b-b911-1be5c2e1118b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1366 microversion: 2.1 time: 0.204446 Jun 07 13:26:46.856147 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 610/1224] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:46 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:47.874954 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:47.875694 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:47.882725 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.883193 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:47.884095 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:47.884504 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:48.038195 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:26:48.046230 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ee1110ae-a278-403d-8c11-ec19b194670b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1556 microversion: 2.1 time: 0.175358 Jun 07 13:26:48.047023 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 615/1225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:26:47 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:26:48.063789 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:26:48.064392 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:26:48.071243 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:48.071741 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:48.072454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:48.072919 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:48.155174 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d2cca1d-5ffa-4bcb-8ba4-b9b54203ef28 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095254 Jun 07 13:26:48.155783 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 611/1226] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jun 7 13:26:48 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:26:49.230290 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-0d94b053-9bbe-4429-bbf8-b89d9b3b7b1c req-d0d17dcc-8737-4fb9-9156-1059c4be36c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff24477-c683-43f2-bf86-bc7cd967ae01", "tag": "cf919e4b-1897-44e2-8833-497d33d97868"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:26:49.239875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0d94b053-9bbe-4429-bbf8-b89d9b3b7b1c req-d0d17dcc-8737-4fb9-9156-1059c4be36c1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:26:49.240317 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-0d94b053-9bbe-4429-bbf8-b89d9b3b7b1c req-d0d17dcc-8737-4fb9-9156-1059c4be36c1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:26:49.252809 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-0d94b053-9bbe-4429-bbf8-b89d9b3b7b1c req-d0d17dcc-8737-4fb9-9156-1059c4be36c1 service nova] Creating event network-changed:cf919e4b-1897-44e2-8833-497d33d97868 for instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 on hv-cinder-84496 Jun 07 13:26:49.259447 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-0d94b053-9bbe-4429-bbf8-b89d9b3b7b1c req-d0d17dcc-8737-4fb9-9156-1059c4be36c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032383 Jun 07 13:26:49.260441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 616/1227] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:27:38.780087 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=3 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.781039 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=53 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.787202 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:27:38.788740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:38.796979 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.797445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:38.798211 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.798639 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:38.900305 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-055bba72-93f0-4259-af68-27364132880b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action" status: 202 len: 0 microversion: 2.1 time: 0.120882 Jun 07 13:27:38.901350 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 612/1228] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:27:38 2022] POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:27:38.914653 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:38.915892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:38.923510 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.924592 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:27:38.934167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.934945 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:38.936623 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:38.937441 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:39.307108 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:39.316534 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-99d1544c-f910-47a5-874f-4a2cc4dff78b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1750 microversion: 2.1 time: 0.409389 Jun 07 13:27:39.317156 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 617/1229] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:38 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1750 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:40.339757 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:40.340447 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:40.348079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:40.348518 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:40.349323 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:40.349756 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:40.572454 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:40.582626 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-2a61182e-1152-405e-a760-0d04e455bb1f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.247094 Jun 07 13:27:40.583288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 613/1230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:40 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:41.602556 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:41.604482 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:41.612056 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:41.612349 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:41.613176 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:41.613618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:41.775588 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:41.784912 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-5435acf8-f4eb-4520-9264-1d81ccc462d9 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.186779 Jun 07 13:27:41.785538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 618/1231] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:41 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:42.802891 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:42.803549 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:42.810143 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:42.810586 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:42.811755 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:42.812213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:42.965977 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:42.974886 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-b822953f-4dc1-48e2-bb30-b6b05f84ea87 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.176214 Jun 07 13:27:42.975472 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 614/1232] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:42 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:43.994075 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:43.994847 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:44.001558 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:44.002016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:44.002817 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:44.003255 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:44.176790 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:44.185584 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-8d45ff32-5beb-4c92-b4e1-97d12d96e07c tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.196333 Jun 07 13:27:44.186238 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 619/1233] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:43 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:45.204834 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:45.205630 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:45.212973 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:45.213461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:45.214252 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:45.214699 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:45.389377 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:45.399315 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-78741eb4-ea8f-455e-88dc-c77ebaa12ece tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.198477 Jun 07 13:27:45.399894 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 615/1234] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:45 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:46.420812 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:46.421672 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:46.428555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.428999 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.429798 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:46.430306 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:46.614045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:46.624687 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-091992e1-b960-48be-bdcf-2fd0b7e72a32 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.208834 Jun 07 13:27:46.625444 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 620/1235] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:46 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:47.646198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:47.647434 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:47.657748 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:47.658338 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:47.659500 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:47.660171 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:47.830339 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:47.840883 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-501debe9-4ffa-466c-9957-93c7d5d57c70 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.201492 Jun 07 13:27:47.841508 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 616/1236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:47 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:48.859887 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:48.860838 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:48.867940 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:48.868369 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:48.869179 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:48.869618 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:49.055001 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:49.069242 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-572f3620-a01c-4cf6-963e-d35078598059 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.213705 Jun 07 13:27:49.069837 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 621/1237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:48 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:50.089041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:50.089685 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:50.096677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:50.097159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:50.097929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:50.098389 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:50.253774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:50.268006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6dff06c7-5e8a-4915-9613-c27dc769d677 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.182765 Jun 07 13:27:50.268616 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 617/1238] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:50 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:51.286298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:51.286894 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:51.294078 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:51.294532 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:51.295304 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:51.296278 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:51.458689 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:51.467337 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c454bbb7-1116-4951-9c36-47dd2f5c87f6 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.185075 Jun 07 13:27:51.468476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 622/1239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:51 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:52.493405 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:52.494028 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:52.500971 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.501448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.502228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:52.502653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:52.660872 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:52.669280 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-348e32bf-3378-47a3-bdb9-a70bb4a836b1 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.179878 Jun 07 13:27:52.669857 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 618/1240] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:52 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:27:53.687700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:53.688344 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:53.695602 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:53.696048 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:53.696825 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:53.697305 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:53.861194 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:53.870016 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-c835b735-97b9-45c2-a862-30abdbbe6040 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.186631 Jun 07 13:27:53.870600 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 623/1241] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:53 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:54.888413 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:54.888993 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:54.896177 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.896604 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:54.897445 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:54.897859 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:55.087063 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:55.100118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-820089fb-d2ef-450a-bbf2-5f2898a9e6ac tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1755 microversion: 2.1 time: 0.215549 Jun 07 13:27:55.101251 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 619/1242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:54 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:27:56.119224 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:27:56.119944 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:27:56.126960 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.127465 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.128294 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:27:56.128737 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:27:56.291633 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:27:56.301433 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-21751c4d-18f9-4cd1-aeae-baca99076c84 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1758 microversion: 2.1 time: 0.185968 Jun 07 13:27:56.302231 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 624/1243] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:27:56 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:04.306311 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:04.307269 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:04.315645 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.316079 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.316990 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:04.317485 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:04.347970 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-08438019-e6b0-45f4-9fc6-c4e898d1bde6 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/ips" status: 200 len: 149 microversion: 2.1 time: 0.045517 Jun 07 13:28:04.348709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 620/1244] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jun 7 13:28:04 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:05.742512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "830e4893-9773-4f3e-b098-ad48375f1b7e"}} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:05.743641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:05.750578 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.751025 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:05.751789 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:05.752218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:06.016826 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e7e05a93-46eb-4812-b0a9-2f9708561319 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "POST /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278345 Jun 07 13:28:06.017483 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 625/1245] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jun 7 13:28:05 2022] POST /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:13.679580 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:13.680172 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:13.682130 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=19 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:13.688675 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.689175 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.689983 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.690409 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.693654 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:13.780942 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lazy-loading 'services' on Instance uuid 2ff24477-c683-43f2-bf86-bc7cd967ae01 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:28:13.863533 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-3cda5b1d-c4ff-40a6-bf5e-920afd120ff1 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments/830e4893-9773-4f3e-b098-ad48375f1b7e" status: 202 len: 0 microversion: 2.1 time: 0.187987 Jun 07 13:28:13.864112 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 621/1246] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:28:13 2022] DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments/830e4893-9773-4f3e-b098-ad48375f1b7e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:13.876848 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:13.878051 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:13.880047 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=19 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:13.885682 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.886128 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.886936 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:13.887371 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:13.890635 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:13.920743 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-b84067f5-72af-4f0b-9ed1-d3e99bc241e8 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048513 Jun 07 13:28:13.921303 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 626/1247] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:28:13 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:14.933968 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:14.935659 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:14.942653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.943103 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.943880 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:14.944312 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:14.980917 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-ca53f9e8-069e-4aee-8b11-4e7339e0134b tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051724 Jun 07 13:28:14.982431 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 622/1248] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:28:14 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:28:15.050993 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:15.051574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:15.058365 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.058871 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.059907 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.060389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.088158 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:28:15.177646 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ce165a93-e2ac-47e1-a56a-44c43f5d7b88 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 204 len: 0 microversion: 2.1 time: 0.130125 Jun 07 13:28:15.178628 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 627/1249] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:15 2022] DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 13:28:15.188222 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:15.188745 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:15.195448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.195448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.196790 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:15.197385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:15.350960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:15.362110 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6a68a5a4-2554-47fe-b871-c1ba6d886f38 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1680 microversion: 2.1 time: 0.178361 Jun 07 13:28:15.362974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 623/1250] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:15 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 13:28:16.381833 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:16.382718 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:16.391019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.391476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.392260 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:16.392692 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:16.538806 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:16.547883 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-410dfc52-d78f-44e4-ab7d-e91be42570aa tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1680 microversion: 2.1 time: 0.171157 Jun 07 13:28:16.548538 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 628/1251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:16 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:17.568520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:17.569490 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:17.576749 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:17.577665 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:17.578781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:17.579231 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:17.754517 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1524fd1042430e97bb60caafef26f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa6e76580734bf5980477d32c87bfc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:28:17.762837 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d4592c0f-be8d-47ee-9720-7f57b27c769d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 200 len: 1680 microversion: 2.1 time: 0.198392 Jun 07 13:28:17.763443 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 624/1252] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:17 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:28:18.109549 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-866ac4c0-a25a-4796-864d-d09baf19d102 req-568d38ca-3595-4a6f-8019-a5ba92608263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff24477-c683-43f2-bf86-bc7cd967ae01", "name": "network-vif-deleted", "tag": "cf919e4b-1897-44e2-8833-497d33d97868"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:18.129311 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-866ac4c0-a25a-4796-864d-d09baf19d102 req-568d38ca-3595-4a6f-8019-a5ba92608263 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:18.130423 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-866ac4c0-a25a-4796-864d-d09baf19d102 req-568d38ca-3595-4a6f-8019-a5ba92608263 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:18.144554 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-866ac4c0-a25a-4796-864d-d09baf19d102 req-568d38ca-3595-4a6f-8019-a5ba92608263 service nova] Creating event network-vif-deleted:cf919e4b-1897-44e2-8833-497d33d97868 for instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 on hv-cinder-84496 Jun 07 13:28:18.150709 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-866ac4c0-a25a-4796-864d-d09baf19d102 req-568d38ca-3595-4a6f-8019-a5ba92608263 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128011 Jun 07 13:28:18.151790 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 629/1253] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:28:18.781044 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:18.782020 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:18.789261 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:18.789709 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:18.792432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:18.792432 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:18.807653 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 HTTP/1.1 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:28:18.809369 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:18.812136 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '2ff24477-c683-43f2-bf86-bc7cd967ae01'} Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:18.813962 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:18.816768 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:18.819704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:18.819704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-19676a47-cd36-4857-bc0d-6e16426d2d14 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 404 len: 111 microversion: 2.1 time: 0.034070 Jun 07 13:28:18.819704 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 625/1254] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:18 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:28:18.824030 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1d1c94ca-418f-4a81-8881-a999257655ef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '.version_select at 0x7f20a465f9d0>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:18.852866 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1d1c94ca-418f-4a81-8881-a999257655ef tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-358748480" status: 202 len: 0 microversion: 2.1 time: 0.034633 Jun 07 13:28:18.857763 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 630/1255] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jun 7 13:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-358748480 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:28:20.773159 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:20.774041 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:20.782474 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:20.782960 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:20.783734 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:20.784184 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:20.801191 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 HTTP/1.1 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:28:20.802832 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.805677 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '2ff24477-c683-43f2-bf86-bc7cd967ae01'} Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:20.807375 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.810076 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.812774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:20.812774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-d5cc8a49-5952-4441-a8e6-e014886b5c7f tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 404 len: 111 microversion: 2.1 time: 0.035321 Jun 07 13:28:20.812774 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 626/1256] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:20 2022] DELETE /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:20.814696 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:20.815488 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 2ff24477-c683-43f2-bf86-bc7cd967ae01] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:20.823382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:20.823846 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:20.824641 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:20.825258 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:20.844019 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 HTTP/1.1 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:28:20.845747 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.848200 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '2ff24477-c683-43f2-bf86-bc7cd967ae01'} Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:20.849382 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. Jun 07 13:28:20.851070 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:20.853186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 2ff24477-c683-43f2-bf86-bc7cd967ae01 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:20.853186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-e58034fe-8409-4bd8-a514-ecab6bbd6bdf tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01" status: 404 len: 111 microversion: 2.1 time: 0.037321 Jun 07 13:28:20.853186 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 631/1257] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:20 2022] GET /compute/v2.1/servers/2ff24477-c683-43f2-bf86-bc7cd967ae01 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:22.016740 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:22.017520 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:22.024334 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.024782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.025591 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.026029 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.040820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 HTTP/1.1 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:28:22.044118 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.046150 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '12378db2-7d47-48c5-bec0-3ca2b6ea9b15'} Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:22.047126 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.049448 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.052006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:22.052006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-a5371822-c8da-4822-ae54-0b623acccee3 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 404 len: 111 microversion: 2.1 time: 0.035123 Jun 07 13:28:22.052006 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 627/1258] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:22 2022] DELETE /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:22.056684 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:22.057329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 12378db2-7d47-48c5-bec0-3ca2b6ea9b15] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:22.065640 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.066568 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.066700 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.067167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.084026 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 HTTP/1.1 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:28:22.085599 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.088463 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '12378db2-7d47-48c5-bec0-3ca2b6ea9b15'} Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:22.090272 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. Jun 07 13:28:22.092726 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.094972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 12378db2-7d47-48c5-bec0-3ca2b6ea9b15 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:22.094972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-f76cb2ba-2d68-4872-babb-45f98ad85581 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15" status: 404 len: 111 microversion: 2.1 time: 0.034626 Jun 07 13:28:22.094972 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 632/1259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:22 2022] GET /compute/v2.1/servers/12378db2-7d47-48c5-bec0-3ca2b6ea9b15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:22.098974 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:22.099461 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:22.105750 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.106198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.106959 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.107385 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.122057 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 HTTP/1.1 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:28:22.123897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.125784 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '3e7fcb9a-d081-447d-bb1e-02f1f08b3f71'} Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:22.126733 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.128035 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.129492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:22.129492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-02a4172d-eb16-4c9e-b422-d492c0c881d7 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 404 len: 111 microversion: 2.1 time: 0.030961 Jun 07 13:28:22.129492 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 628/1260] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:22 2022] DELETE /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:28:22.136329 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:22.136941 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:22.143617 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.144057 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.144827 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:22.145281 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:22.159048 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 HTTP/1.1 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:28:22.160573 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.163514 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': '3e7fcb9a-d081-447d-bb1e-02f1f08b3f71'} Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:22.164437 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. Jun 07 13:28:22.166770 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:22.169167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance 3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:22.169167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-48de115f-3930-4cd6-9903-cfa4dc0cf59d tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71" status: 404 len: 111 microversion: 2.1 time: 0.029796 Jun 07 13:28:22.169167 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 633/1261] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:22 2022] GET /compute/v2.1/servers/3e7fcb9a-d081-447d-bb1e-02f1f08b3f71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 13:28:23.310356 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:23.311335 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:23.318450 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:23.318899 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:23.319672 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:23.320531 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:23.334528 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e HTTP/1.1 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:28:23.336082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.338127 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': 'ff5f1573-0c99-4a11-a312-4736459f884e'} Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:23.339296 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.340782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.342532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:23.342532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-6cad7a2f-dfae-4483-97ae-d5bb7678ffed tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jun 07 13:28:23.342532 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 629/1262] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:28:23 2022] DELETE /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:23.347368 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:28:23.348254 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] [instance: ff5f1573-0c99-4a11-a312-4736459f884e] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:23.358654 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:23.359253 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:23.360807 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:23.361571 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:23.382045 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.wsgi [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] HTTP exception thrown: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Request method failure captured: Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: request: GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e HTTP/1.1 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept: application/json Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Accept-Encoding: identity Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Connection: close Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Length: 0 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Content-Type: application/json Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Host: 10.222.0.20 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Openstack-System-Scope: None Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: User-Agent: python-urllib3/1.26.9 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Auth-Token: gAAAAABin1BCL_wwM7Jnax0ls6qCDiHfF00SI6eMwX_8V9l7bqR0365Wqk9VaSOwk_LfqFGLfBjrUJen5Aki3Y7MkQKfPXfJGLs1hiPiOUUApa0UMfqWbtyCWLwRjlFGxlNv7dHQB366bukcXtNlf51kKGBeWHnn64JImp1mDUk7Gl2LcchjgYI Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Id: None Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Domain-Name: None Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Identity-Status: Confirmed Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Is-Admin-Project: True Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Id: default Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Domain-Name: Default Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Project-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Role: member,reader Jun 07 13:28:23.383574 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Roles: member,reader Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fa6e76580734bf5980477d32c87bfc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Id: 0fa6e76580734bf5980477d32c87bfc1 Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-454825740 Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Id: default Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Domain-Name: Default Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Id: bf1524fd1042430e97bb60caafef26f3 Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: X-User-Name: tempest-AttachVolumeNegativeTest-454825740-project Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: method: > Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: exception: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.386875 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: action_args: {'id': 'ff5f1573-0c99-4a11-a312-4736459f884e'} Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:28:23.387811 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. Jun 07 13:28:23.389461 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: ERROR nova.api.openstack.wsgi Jun 07 13:28:23.390948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] Returning 404 to user: Instance ff5f1573-0c99-4a11-a312-4736459f884e could not be found. {{(pid=117832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:28:23.390948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-44036632-cf54-42b2-8666-a3001ea66748 tempest-AttachVolumeNegativeTest-454825740 tempest-AttachVolumeNegativeTest-454825740-project] 10.222.0.20 "GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e" status: 404 len: 111 microversion: 2.1 time: 0.042573 Jun 07 13:28:23.390948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 634/1263] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:28:23 2022] GET /compute/v2.1/servers/ff5f1573-0c99-4a11-a312-4736459f884e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:28:45.382445 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:28:45.383299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Tue Jun 7 13:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:28:59.624198 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1448622346"}} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:28:59.625082 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:28:59.630325 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_api:SELECT=17 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:59.631349 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG dbcounter [-] [117833] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=117833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:28:59.644233 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:59.644870 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:59.646177 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:28:59.646896 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:28:59.857566 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.network.security_group_api [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Removing security group 05d004de-1d12-4d9c-b3db-0dc25cbd4ee4 from port 4162d2f8-1af5-4f68-b874-9646131effc2 Jun 07 13:29:00.314093 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-e4028f74-2ed1-40fd-9171-f70a10231795 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action" status: 202 len: 0 microversion: 2.1 time: 0.691193 Jun 07 13:29:00.315671 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 630/1264] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jun 7 13:28:59 2022] POST /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:00.324658 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:00.326378 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG dbcounter [-] [117832] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 13:29:00.526762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-44e45bf2-1280-483b-8095-0f5ea85daec9 req-c55065b8-364e-44cb-8d7e-639293116ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:29:00.539716 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-44e45bf2-1280-483b-8095-0f5ea85daec9 req-c55065b8-364e-44cb-8d7e-639293116ff1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:00.540345 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-44e45bf2-1280-483b-8095-0f5ea85daec9 req-c55065b8-364e-44cb-8d7e-639293116ff1 service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:00.562389 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-44e45bf2-1280-483b-8095-0f5ea85daec9 req-c55065b8-364e-44cb-8d7e-639293116ff1 service nova] Creating event network-changed:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:29:00.573948 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-44e45bf2-1280-483b-8095-0f5ea85daec9 req-c55065b8-364e-44cb-8d7e-639293116ff1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258690 Jun 07 13:29:00.575742 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 635/1265] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 13:29:02.061897 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:02.062514 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:02.070293 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:02.070822 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:02.071625 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:02.072104 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:02.401739 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.objects.instance [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lazy-loading 'services' on Instance uuid 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 {{(pid=117833) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 13:29:02.502949 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-1eedef43-51f4-42e9-8f1d-66a3edea67ba tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments/719578cd-db53-4c97-9694-5ad48f8c6b35" status: 202 len: 0 microversion: 2.1 time: 0.444483 Jun 07 13:29:02.505590 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 631/1266] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:29:02 2022] DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments/719578cd-db53-4c97-9694-5ad48f8c6b35 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:29:02.516330 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:02.518922 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:02.529745 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:02.531223 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:02.532235 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:02.533388 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:02.571633 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-6ba854a0-c7ea-4630-bcd1-69a4025f3b06 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060644 Jun 07 13:29:02.572218 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 636/1267] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:02 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:02.596536 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [req-0a37279c-0fc3-4283-bd7d-4e53a7864d24 req-ab08ac4d-e64b-4a21-9867-3888f6cbd8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:29:02.618571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0a37279c-0fc3-4283-bd7d-4e53a7864d24 req-ab08ac4d-e64b-4a21-9867-3888f6cbd8bd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:02.619228 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [req-0a37279c-0fc3-4283-bd7d-4e53a7864d24 req-ab08ac4d-e64b-4a21-9867-3888f6cbd8bd service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:02.641762 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.compute.server_external_events [req-0a37279c-0fc3-4283-bd7d-4e53a7864d24 req-ab08ac4d-e64b-4a21-9867-3888f6cbd8bd service nova] Creating event network-changed:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:29:02.648585 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [req-0a37279c-0fc3-4283-bd7d-4e53a7864d24 req-ab08ac4d-e64b-4a21-9867-3888f6cbd8bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056436 Jun 07 13:29:02.650366 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 632/1268] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:03.584081 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:03.585082 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:03.592332 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.593005 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.594178 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.594680 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.633351 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-50c62b5f-4ad7-41ea-b0c3-9b4ec15d5a20 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053157 Jun 07 13:29:03.633929 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 637/1269] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jun 7 13:29:03 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 13:29:03.645288 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:03.645923 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:03.652487 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.652940 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.653769 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:03.654208 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:03.743426 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] HTTP exception thrown: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 is not attached to volume 719578cd-db53-4c97-9694-5ad48f8c6b35 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Request method failure captured: Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments/719578cd-db53-4c97-9694-5ad48f8c6b35 HTTP/1.1 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1HPLQoHdgkhU9c6bVNUBxQW-gOF5ptwfob_Ye4ofHTA7bNZFQTwmz4vS86Fd4nLKzbtKdt2DXrc_x61IImzcpXvR2SJaCFs_z0l7BTadQ_MokVClOe6lFxR-46e6kcA_6Rz1VZREYLs-Bw2pAJjs0qCJfdQrl6wxFSLtkfyLRwpu-I Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: e94ac089c7dd468b8f0ca7f8fa14769e Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:29:03.746120 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: e94ac089c7dd468b8f0ca7f8fa14769e Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-TestMinimumBasicScenario-526802915-project Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 0ff2575eecdc4e668844f62411861db9 Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestMinimumBasicScenario-526802915-project Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:29:03.748747 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 is not attached to volume 719578cd-db53-4c97-9694-5ad48f8c6b35 Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'server_id': '7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291', 'id': '719578cd-db53-4c97-9694-5ad48f8c6b35'} Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 719578cd-db53-4c97-9694-5ad48f8c6b35. Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:03.749882 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 is not attached to volume 719578cd-db53-4c97-9694-5ad48f8c6b35 Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 is not attached to volume 719578cd-db53-4c97-9694-5ad48f8c6b35 Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:03.751364 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Returning 404 to user: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 is not attached to volume 719578cd-db53-4c97-9694-5ad48f8c6b35 {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:03.752610 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4dcc6976-67d8-477f-9217-f20624c74de2 tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments/719578cd-db53-4c97-9694-5ad48f8c6b35" status: 404 len: 154 microversion: 2.1 time: 0.108569 Jun 07 13:29:03.752931 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 633/1270] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jun 7 13:29:03 2022] DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291/os-volume_attachments/719578cd-db53-4c97-9694-5ad48f8c6b35 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:04.914049 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:04.914645 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:04.920991 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:04.921476 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:04.922264 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:04.922706 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:04.950557 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Going to try to terminate instance {{(pid=117832) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 13:29:05.043670 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-ae68e415-3cc1-4dfb-ba2d-9260aa8c821b tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 204 len: 0 microversion: 2.1 time: 0.134291 Jun 07 13:29:05.044330 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 638/1271] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jun 7 13:29:04 2022] DELETE /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 13:29:05.054635 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:05.055388 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:05.062306 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:05.062744 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:05.063504 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:05.063929 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:05.214782 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:05.223214 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-4d7d843e-c330-4848-b744-7466b366736d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1553 microversion: 2.1 time: 0.173594 Jun 07 13:29:05.223781 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 634/1272] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:05 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:06.242412 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:06.243029 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.compute.api [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117832) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:06.250300 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:06.250752 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:06.251594 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:06.251970 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:06.399385 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.policy [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117832) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:06.408299 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-726c1efd-5d1d-46b0-b5c2-0fd69a86d8ab tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1553 microversion: 2.1 time: 0.171475 Jun 07 13:29:06.408874 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 639/1273] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:06 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:07.428479 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:07.429213 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:07.437121 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:07.437854 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:07.438655 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:07.439091 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:07.684571 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.policy [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff2575eecdc4e668844f62411861db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94ac089c7dd468b8f0ca7f8fa14769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117833) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 13:29:07.693415 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-284a4d51-3a12-4250-b191-2d74c02c857f tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 200 len: 1553 microversion: 2.1 time: 0.270352 Jun 07 13:29:07.694331 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 635/1274] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:07 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 13:29:07.835533 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [req-44cc9d46-2092-48cc-884e-0282e99b8faa req-2e84355e-78af-48b5-9114-6a3a1f476d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291", "name": "network-vif-deleted", "tag": "4162d2f8-1af5-4f68-b874-9646131effc2"}]} {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 13:29:07.849695 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-44cc9d46-2092-48cc-884e-0282e99b8faa req-2e84355e-78af-48b5-9114-6a3a1f476d5b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:07.854649 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG oslo_concurrency.lockutils [req-44cc9d46-2092-48cc-884e-0282e99b8faa req-2e84355e-78af-48b5-9114-6a3a1f476d5b service nova] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:07.877762 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.compute.server_external_events [req-44cc9d46-2092-48cc-884e-0282e99b8faa req-2e84355e-78af-48b5-9114-6a3a1f476d5b service nova] Creating event network-vif-deleted:4162d2f8-1af5-4f68-b874-9646131effc2 for instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 on hv-cinder-84496 Jun 07 13:29:07.883911 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [req-44cc9d46-2092-48cc-884e-0282e99b8faa req-2e84355e-78af-48b5-9114-6a3a1f476d5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056829 Jun 07 13:29:07.884446 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 640/1275] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jun 7 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 13:29:08.712086 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '>' {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:08.712794 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.compute.api [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] [instance: 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291] Fetching instance by UUID {{(pid=117833) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 13:29:08.719624 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:08.719998 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:08.720752 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 13:29:08.721404 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG oslo_concurrency.lockutils [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Lock "af0611bb-ba94-47a7-9ba7-fca8b65e4503" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 13:29:08.737227 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.wsgi [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] HTTP exception thrown: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Request method failure captured: Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: request: GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 HTTP/1.1 Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept: application/json Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Accept-Encoding: identity Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Connection: close Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Length: 0 Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Content-Type: application/json Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Host: 10.222.0.20 Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Openstack-System-Scope: None Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: User-Agent: python-urllib3/1.26.9 Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Auth-Token: gAAAAABin1HPLQoHdgkhU9c6bVNUBxQW-gOF5ptwfob_Ye4ofHTA7bNZFQTwmz4vS86Fd4nLKzbtKdt2DXrc_x61IImzcpXvR2SJaCFs_z0l7BTadQ_MokVClOe6lFxR-46e6kcA_6Rz1VZREYLs-Bw2pAJjs0qCJfdQrl6wxFSLtkfyLRwpu-I Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Id: None Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Domain-Name: None Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Identity-Status: Confirmed Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Is-Admin-Project: True Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Id: default Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Domain-Name: Default Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Id: e94ac089c7dd468b8f0ca7f8fa14769e Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Project-Name: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Role: member,reader Jun 07 13:29:08.739285 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Roles: member,reader Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e94ac089c7dd468b8f0ca7f8fa14769e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Id: e94ac089c7dd468b8f0ca7f8fa14769e Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-Tenant-Name: tempest-TestMinimumBasicScenario-526802915 Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User: tempest-TestMinimumBasicScenario-526802915-project Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Id: default Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Domain-Name: Default Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Id: 0ff2575eecdc4e668844f62411861db9 Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: X-User-Name: tempest-TestMinimumBasicScenario-526802915-project Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: method: > Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: exception: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. Jun 07 13:29:08.740876 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: action_args: {'id': '7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291'} Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: {{(pid=117833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 13:29:08.742345 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. Jun 07 13:29:08.743991 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: ERROR nova.api.openstack.wsgi Jun 07 13:29:08.745543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: DEBUG nova.api.openstack.wsgi [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Returning 404 to user: Instance 7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 could not be found. {{(pid=117833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 13:29:08.745543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO nova.api.openstack.requestlog [None req-7ee085ad-1499-4ca1-980f-84344ee6f65d tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291" status: 404 len: 111 microversion: 2.1 time: 0.032728 Jun 07 13:29:08.745543 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: [pid: 117833|app: 0|req: 636/1276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jun 7 13:29:08 2022] GET /compute/v2.1/servers/7f0a2715-86a7-4cc4-9f8e-aeb8f1b21291 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 13:29:08.750893 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: DEBUG nova.api.openstack.wsgi [None req-1f32da10-415a-4b25-b656-7c368097a6ad tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] Calling method '.version_select at 0x7f20a466d430>' {{(pid=117832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 13:29:08.770957 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO nova.api.openstack.requestlog [None req-1f32da10-415a-4b25-b656-7c368097a6ad tempest-TestMinimumBasicScenario-526802915 tempest-TestMinimumBasicScenario-526802915-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-397922641" status: 202 len: 0 microversion: 2.1 time: 0.024322 Jun 07 13:29:08.771555 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: [pid: 117832|app: 0|req: 641/1277] 10.222.0.20 () {58 vars in 1268 bytes} [Tue Jun 7 13:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-397922641 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 13:31:54.111272 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:31:54.112109 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Tue Jun 7 13:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:31:59.598927 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:31:59.599548 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Tue Jun 7 13:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:32:02.020820 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:32:02.021437 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Tue Jun 7 13:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:32:05.392892 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:32:05.393512 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Tue Jun 7 13:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:32:07.734298 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:32:07.734978 dv-cinder-844962-1-iscsi devstack@n-api.service[117832]: Tue Jun 7 13:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 13:34:16.661295 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 13:34:16.661868 dv-cinder-844962-1-iscsi devstack@n-api.service[117833]: Tue Jun 7 13:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!